2023-02-12 03:03:14,738 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-12 03:03:14,784 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=167, AvailableMemoryMB=6770 2023-02-12 03:03:15,074 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d 2023-02-12 03:03:15,081 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:03:15,082 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df, deleteOnExit=true 2023-02-12 03:03:15,082 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:03:15,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/test.cache.data in system properties and HBase conf 2023-02-12 03:03:15,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:03:15,083 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:03:15,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:03:15,084 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:03:15,085 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:03:15,195 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 03:03:15,580 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:03:15,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:15,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:15,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:03:15,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:15,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:03:15,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:03:15,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:15,589 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:15,589 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:03:15,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:03:15,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:03:15,590 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:15,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:03:15,591 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:03:16,074 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:16,078 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:16,346 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 03:03:16,503 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 03:03:16,520 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:16,560 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:16,597 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/java.io.tmpdir/Jetty_localhost_46013_hdfs____zgulve/webapp 2023-02-12 03:03:16,750 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46013 2023-02-12 03:03:16,762 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:16,762 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:17,308 WARN [Listener at localhost/35265] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:17,395 WARN [Listener at localhost/35265] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:17,418 WARN [Listener at localhost/35265] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:17,424 INFO [Listener at localhost/35265] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:17,429 INFO [Listener at localhost/35265] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/java.io.tmpdir/Jetty_localhost_44629_datanode____.2gqbrw/webapp 2023-02-12 03:03:17,570 INFO [Listener at localhost/35265] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44629 2023-02-12 03:03:18,047 WARN [Listener at localhost/37815] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:18,073 WARN [Listener at localhost/37815] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:18,077 WARN [Listener at localhost/37815] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:18,079 INFO [Listener at localhost/37815] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:18,089 INFO [Listener at localhost/37815] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/java.io.tmpdir/Jetty_localhost_33219_datanode____yahs9t/webapp 2023-02-12 03:03:18,224 INFO [Listener at localhost/37815] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33219 2023-02-12 03:03:18,242 WARN [Listener at localhost/42187] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:18,593 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd715a61d644d443c: Processing first storage report for DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6 from datanode a0f173a4-058f-4fa5-bdf5-574fb4c49a00 2023-02-12 03:03:18,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd715a61d644d443c: from storage DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6 node DatanodeRegistration(127.0.0.1:42595, datanodeUuid=a0f173a4-058f-4fa5-bdf5-574fb4c49a00, infoPort=45577, infoSecurePort=0, ipcPort=37815, storageInfo=lv=-57;cid=testClusterID;nsid=951372157;c=1676170996146), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-12 03:03:18,595 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb6b3306dd116dc1: Processing first storage report for DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1 from datanode c0b66b69-e13b-431d-8ba5-2aa60bd4afa0 2023-02-12 03:03:18,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb6b3306dd116dc1: from storage DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1 node DatanodeRegistration(127.0.0.1:37287, datanodeUuid=c0b66b69-e13b-431d-8ba5-2aa60bd4afa0, infoPort=46219, infoSecurePort=0, ipcPort=42187, storageInfo=lv=-57;cid=testClusterID;nsid=951372157;c=1676170996146), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:18,595 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd715a61d644d443c: Processing first storage report for DS-619d0720-07ce-40ee-aa4f-caec45370459 from datanode a0f173a4-058f-4fa5-bdf5-574fb4c49a00 2023-02-12 03:03:18,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd715a61d644d443c: from storage DS-619d0720-07ce-40ee-aa4f-caec45370459 node DatanodeRegistration(127.0.0.1:42595, datanodeUuid=a0f173a4-058f-4fa5-bdf5-574fb4c49a00, infoPort=45577, infoSecurePort=0, ipcPort=37815, storageInfo=lv=-57;cid=testClusterID;nsid=951372157;c=1676170996146), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:18,596 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdb6b3306dd116dc1: Processing first storage report for DS-f5c80c7b-0733-41cf-b566-66a06532c2cf from datanode c0b66b69-e13b-431d-8ba5-2aa60bd4afa0 2023-02-12 03:03:18,596 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdb6b3306dd116dc1: from storage DS-f5c80c7b-0733-41cf-b566-66a06532c2cf node DatanodeRegistration(127.0.0.1:37287, datanodeUuid=c0b66b69-e13b-431d-8ba5-2aa60bd4afa0, infoPort=46219, infoSecurePort=0, ipcPort=42187, storageInfo=lv=-57;cid=testClusterID;nsid=951372157;c=1676170996146), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:18,685 DEBUG [Listener at localhost/42187] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d 2023-02-12 03:03:18,775 INFO [Listener at localhost/42187] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/zookeeper_0, clientPort=58721, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:03:18,796 INFO [Listener at localhost/42187] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58721 2023-02-12 03:03:18,809 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:18,812 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:19,504 INFO [Listener at localhost/42187] util.FSUtils(479): Created version file at hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161 with version=8 2023-02-12 03:03:19,505 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:19,507 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:19,510 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/hbase-staging 2023-02-12 03:03:19,882 INFO [Listener at localhost/42187] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 03:03:20,395 INFO [Listener at localhost/42187] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:20,429 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,429 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,429 INFO [Listener at localhost/42187] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:20,429 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,430 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:20,579 INFO [Listener at localhost/42187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:20,653 DEBUG [Listener at localhost/42187] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 03:03:20,748 INFO [Listener at localhost/42187] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44827 2023-02-12 03:03:20,759 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:20,762 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:20,789 INFO [Listener at localhost/42187] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44827 connecting to ZooKeeper ensemble=127.0.0.1:58721 2023-02-12 03:03:20,838 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:448270x0, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:20,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44827-0x10154e8e8250000 connected 2023-02-12 03:03:20,871 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:20,872 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:20,876 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:20,884 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44827 2023-02-12 03:03:20,885 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44827 2023-02-12 03:03:20,885 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44827 2023-02-12 03:03:20,886 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44827 2023-02-12 03:03:20,886 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44827 2023-02-12 03:03:20,893 INFO [Listener at localhost/42187] master.HMaster(439): hbase.rootdir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161, hbase.cluster.distributed=false 2023-02-12 03:03:20,967 INFO [Listener at localhost/42187] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:20,967 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,968 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,968 INFO [Listener at localhost/42187] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:20,968 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:20,968 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:20,973 INFO [Listener at localhost/42187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:20,976 INFO [Listener at localhost/42187] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39031 2023-02-12 03:03:20,979 INFO [Listener at localhost/42187] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:20,987 DEBUG [Listener at localhost/42187] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:20,988 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:20,990 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:20,992 INFO [Listener at localhost/42187] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39031 connecting to ZooKeeper ensemble=127.0.0.1:58721 2023-02-12 03:03:20,996 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:390310x0, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:20,997 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:390310x0, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:20,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39031-0x10154e8e8250001 connected 2023-02-12 03:03:20,999 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:20,999 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:21,000 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39031 2023-02-12 03:03:21,002 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39031 2023-02-12 03:03:21,003 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39031 2023-02-12 03:03:21,003 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39031 2023-02-12 03:03:21,004 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39031 2023-02-12 03:03:21,019 INFO [Listener at localhost/42187] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:21,019 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:21,019 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:21,020 INFO [Listener at localhost/42187] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:21,020 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:21,020 INFO [Listener at localhost/42187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:21,020 INFO [Listener at localhost/42187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:21,022 INFO [Listener at localhost/42187] ipc.NettyRpcServer(120): Bind to /172.31.2.20:34483 2023-02-12 03:03:21,023 INFO [Listener at localhost/42187] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:21,027 DEBUG [Listener at localhost/42187] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:21,028 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:21,031 INFO [Listener at localhost/42187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:21,034 INFO [Listener at localhost/42187] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34483 connecting to ZooKeeper ensemble=127.0.0.1:58721 2023-02-12 03:03:21,039 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:344830x0, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:21,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34483-0x10154e8e8250002 connected 2023-02-12 03:03:21,040 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:21,041 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:21,041 DEBUG [Listener at localhost/42187] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:21,042 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 03:03:21,043 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34483 2023-02-12 03:03:21,043 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34483 2023-02-12 03:03:21,043 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 03:03:21,046 DEBUG [Listener at localhost/42187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34483 2023-02-12 03:03:21,048 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:21,058 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:21,059 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:21,086 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:21,086 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:21,086 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:21,086 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:21,087 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:21,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:21,089 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,44827,1676170999687 from backup master directory 2023-02-12 03:03:21,093 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:21,093 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:21,094 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:21,094 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:21,097 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 03:03:21,099 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 03:03:21,192 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/hbase.id with ID: a4257092-6747-4df5-a1a4-e7c625523f16 2023-02-12 03:03:21,236 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:21,256 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:21,324 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x66cf3e17 to 127.0.0.1:58721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:21,361 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fce1ad5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:21,388 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:21,390 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:03:21,411 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 03:03:21,411 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 03:03:21,413 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:03:21,418 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:03:21,419 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:21,459 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store-tmp 2023-02-12 03:03:21,495 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:21,496 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:21,496 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:21,496 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:21,496 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:21,496 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:21,496 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:21,497 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171001495Disabling compacts and flushes for region at 1676171001496 (+1 ms)Disabling writes for close at 1676171001496Writing region close event to WAL at 1676171001496Closed at 1676171001496 2023-02-12 03:03:21,499 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/WALs/jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:21,523 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44827%2C1676170999687, suffix=, logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/WALs/jenkins-hbase6.apache.org,44827,1676170999687, archiveDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/oldWALs, maxLogs=10 2023-02-12 03:03:21,589 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK] 2023-02-12 03:03:21,589 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK] 2023-02-12 03:03:21,598 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:03:21,674 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/WALs/jenkins-hbase6.apache.org,44827,1676170999687/jenkins-hbase6.apache.org%2C44827%2C1676170999687.1676171001534 2023-02-12 03:03:21,675 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK], DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK]] 2023-02-12 03:03:21,676 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:21,676 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:21,681 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,682 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,753 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,761 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:03:21,794 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:03:21,809 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:21,815 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,817 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,832 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:21,837 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:21,838 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72173428, jitterRate=0.07546788454055786}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:21,838 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171001717Initializing all the Stores at 1676171001720 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171001720Cleaning up temporary data from old regions at 1676171001823 (+103 ms)Cleaning up detritus from prior splits at 1676171001824 (+1 ms)Region opened successfully at 1676171001838 (+14 ms) 2023-02-12 03:03:21,840 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:03:21,863 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:03:21,863 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:03:21,866 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:03:21,868 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 03:03:21,916 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-02-12 03:03:21,916 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:03:21,951 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:03:21,957 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:03:21,985 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:03:21,990 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:03:21,992 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:03:21,999 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:03:22,003 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:03:22,007 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:22,008 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:03:22,009 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:03:22,024 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:03:22,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:22,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:22,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:22,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:22,032 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,44827,1676170999687, sessionid=0x10154e8e8250000, setting cluster-up flag (Was=false) 2023-02-12 03:03:22,055 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:22,061 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:03:22,063 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:22,069 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:22,075 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:03:22,077 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:22,080 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/.tmp 2023-02-12 03:03:22,151 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(952): ClusterId : a4257092-6747-4df5-a1a4-e7c625523f16 2023-02-12 03:03:22,151 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(952): ClusterId : a4257092-6747-4df5-a1a4-e7c625523f16 2023-02-12 03:03:22,158 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:22,158 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:22,164 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:22,164 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:22,165 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:22,165 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:22,170 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:22,171 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:22,171 DEBUG [RS:1;jenkins-hbase6:34483] zookeeper.ReadOnlyZKClient(139): Connect 0x6a347068 to 127.0.0.1:58721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:22,172 DEBUG [RS:0;jenkins-hbase6:39031] zookeeper.ReadOnlyZKClient(139): Connect 0x77f135e5 to 127.0.0.1:58721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:22,185 DEBUG [RS:0;jenkins-hbase6:39031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32034b17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:22,185 DEBUG [RS:1;jenkins-hbase6:34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@543f703c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:22,187 DEBUG [RS:1;jenkins-hbase6:34483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c9fae3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:22,187 DEBUG [RS:0;jenkins-hbase6:39031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24d1fb8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:22,214 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:34483 2023-02-12 03:03:22,214 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:39031 2023-02-12 03:03:22,220 INFO [RS:1;jenkins-hbase6:34483] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:22,220 INFO [RS:0;jenkins-hbase6:39031] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:22,220 INFO [RS:0;jenkins-hbase6:39031] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:22,220 INFO [RS:1;jenkins-hbase6:34483] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:22,221 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:22,221 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:22,224 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,44827,1676170999687 with isa=jenkins-hbase6.apache.org/172.31.2.20:39031, startcode=1676171000966 2023-02-12 03:03:22,224 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,44827,1676170999687 with isa=jenkins-hbase6.apache.org/172.31.2.20:34483, startcode=1676171001018 2023-02-12 03:03:22,229 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:03:22,241 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,242 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:22,242 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,244 DEBUG [RS:0;jenkins-hbase6:39031] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:22,244 DEBUG [RS:1;jenkins-hbase6:34483] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:22,247 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171032247 2023-02-12 03:03:22,250 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:03:22,252 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:22,253 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:03:22,259 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:22,264 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:03:22,273 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:03:22,274 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:03:22,274 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:03:22,275 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:03:22,284 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:03:22,288 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:03:22,289 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:03:22,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:03:22,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:03:22,295 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171002295,5,FailOnTimeoutGroup] 2023-02-12 03:03:22,298 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171002295,5,FailOnTimeoutGroup] 2023-02-12 03:03:22,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,299 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:03:22,301 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,307 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,319 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:22,321 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:22,321 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161 2023-02-12 03:03:22,327 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53943, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:22,327 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:57781, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:22,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44827] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,347 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,349 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:22,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:22,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/info 2023-02-12 03:03:22,355 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:22,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,358 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:22,360 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:22,361 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:22,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,364 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:22,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/table 2023-02-12 03:03:22,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:22,369 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161 2023-02-12 03:03:22,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,369 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35265 2023-02-12 03:03:22,369 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161 2023-02-12 03:03:22,369 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:22,370 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35265 2023-02-12 03:03:22,370 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:22,371 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740 2023-02-12 03:03:22,372 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740 2023-02-12 03:03:22,376 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:22,377 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:22,379 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:22,383 DEBUG [RS:0;jenkins-hbase6:39031] zookeeper.ZKUtil(162): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,383 WARN [RS:0;jenkins-hbase6:39031] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:22,383 INFO [RS:0;jenkins-hbase6:39031] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:22,383 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:22,383 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,383 DEBUG [RS:1;jenkins-hbase6:34483] zookeeper.ZKUtil(162): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,384 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,34483,1676171001018] 2023-02-12 03:03:22,384 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39031,1676171000966] 2023-02-12 03:03:22,383 WARN [RS:1;jenkins-hbase6:34483] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:22,387 INFO [RS:1;jenkins-hbase6:34483] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:22,388 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,388 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59084208, jitterRate=-0.11957669258117676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:22,388 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171002349Initializing all the Stores at 1676171002351 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171002351Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171002351Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171002351Cleaning up temporary data from old regions at 1676171002374 (+23 ms)Cleaning up detritus from prior splits at 1676171002375 (+1 ms)Region opened successfully at 1676171002388 (+13 ms) 2023-02-12 03:03:22,388 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:22,389 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:22,389 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:22,389 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:22,389 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:22,393 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:22,394 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171002388Disabling compacts and flushes for region at 1676171002388Disabling writes for close at 1676171002389 (+1 ms)Writing region close event to WAL at 1676171002393 (+4 ms)Closed at 1676171002393 2023-02-12 03:03:22,398 DEBUG [RS:1;jenkins-hbase6:34483] zookeeper.ZKUtil(162): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,399 DEBUG [RS:0;jenkins-hbase6:39031] zookeeper.ZKUtil(162): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,399 DEBUG [RS:1;jenkins-hbase6:34483] zookeeper.ZKUtil(162): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,401 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:22,401 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:03:22,403 DEBUG [RS:0;jenkins-hbase6:39031] zookeeper.ZKUtil(162): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,413 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:22,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:03:22,413 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:22,423 INFO [RS:0;jenkins-hbase6:39031] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:22,424 INFO [RS:1;jenkins-hbase6:34483] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:22,427 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:03:22,429 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:03:22,447 INFO [RS:0;jenkins-hbase6:39031] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:22,447 INFO [RS:1;jenkins-hbase6:34483] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:22,452 INFO [RS:0;jenkins-hbase6:39031] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:22,452 INFO [RS:1;jenkins-hbase6:34483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:22,452 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,452 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,453 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:22,453 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:22,463 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,463 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,463 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,463 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,464 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:22,465 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:0;jenkins-hbase6:39031] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,465 DEBUG [RS:1;jenkins-hbase6:34483] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:22,468 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,468 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,468 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,468 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,468 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,468 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,487 INFO [RS:0;jenkins-hbase6:39031] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:22,487 INFO [RS:1;jenkins-hbase6:34483] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:22,491 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,34483,1676171001018-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,491 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39031,1676171000966-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:22,519 INFO [RS:1;jenkins-hbase6:34483] regionserver.Replication(203): jenkins-hbase6.apache.org,34483,1676171001018 started 2023-02-12 03:03:22,519 INFO [RS:0;jenkins-hbase6:39031] regionserver.Replication(203): jenkins-hbase6.apache.org,39031,1676171000966 started 2023-02-12 03:03:22,519 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,34483,1676171001018, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:34483, sessionid=0x10154e8e8250002 2023-02-12 03:03:22,519 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39031,1676171000966, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39031, sessionid=0x10154e8e8250001 2023-02-12 03:03:22,520 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:22,520 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:22,520 DEBUG [RS:1;jenkins-hbase6:34483] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,520 DEBUG [RS:0;jenkins-hbase6:39031] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,520 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,34483,1676171001018' 2023-02-12 03:03:22,520 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39031,1676171000966' 2023-02-12 03:03:22,521 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:22,521 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:22,522 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:22,522 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:22,523 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:22,523 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:22,523 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:22,523 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:22,523 DEBUG [RS:0;jenkins-hbase6:39031] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,523 DEBUG [RS:1;jenkins-hbase6:34483] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:22,524 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,34483,1676171001018' 2023-02-12 03:03:22,524 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39031,1676171000966' 2023-02-12 03:03:22,524 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:22,524 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:22,524 DEBUG [RS:0;jenkins-hbase6:39031] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:22,524 DEBUG [RS:1;jenkins-hbase6:34483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:22,525 DEBUG [RS:0;jenkins-hbase6:39031] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:22,525 INFO [RS:0;jenkins-hbase6:39031] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:22,525 INFO [RS:0;jenkins-hbase6:39031] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:22,525 DEBUG [RS:1;jenkins-hbase6:34483] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:22,525 INFO [RS:1;jenkins-hbase6:34483] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:22,526 INFO [RS:1;jenkins-hbase6:34483] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:22,582 DEBUG [jenkins-hbase6:44827] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:03:22,586 DEBUG [jenkins-hbase6:44827] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:22,593 DEBUG [jenkins-hbase6:44827] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:22,593 DEBUG [jenkins-hbase6:44827] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:22,593 DEBUG [jenkins-hbase6:44827] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:22,596 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39031,1676171000966, state=OPENING 2023-02-12 03:03:22,606 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:03:22,608 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:22,609 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:22,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:22,808 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:22,812 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:22,816 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:22,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:03:22,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:22,837 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39031%2C1676171000966.meta, suffix=.meta, logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,39031,1676171000966, archiveDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs, maxLogs=32 2023-02-12 03:03:22,860 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK] 2023-02-12 03:03:22,863 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK] 2023-02-12 03:03:22,867 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,39031,1676171000966/jenkins-hbase6.apache.org%2C39031%2C1676171000966.meta.1676171002841.meta 2023-02-12 03:03:22,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK], DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK]] 2023-02-12 03:03:22,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:22,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:03:22,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:03:22,899 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:03:22,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:03:22,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:22,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:03:22,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:03:22,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:22,910 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/info 2023-02-12 03:03:22,910 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/info 2023-02-12 03:03:22,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:22,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:22,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:22,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:22,915 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:22,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:22,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/table 2023-02-12 03:03:22,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/table 2023-02-12 03:03:22,918 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:22,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:22,921 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740 2023-02-12 03:03:22,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740 2023-02-12 03:03:22,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:22,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:22,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62736801, jitterRate=-0.06514881551265717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:22,933 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171002905Writing region info on filesystem at 1676171002905Initializing all the Stores at 1676171002907 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171002907Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171002908 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171002908Cleaning up temporary data from old regions at 1676171002927 (+19 ms)Cleaning up detritus from prior splits at 1676171002927Running coprocessor post-open hooks at 1676171002933 (+6 ms)Region opened successfully at 1676171002933 2023-02-12 03:03:22,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171002799 2023-02-12 03:03:22,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:03:22,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:03:22,965 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39031,1676171000966, state=OPEN 2023-02-12 03:03:22,970 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:03:22,970 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:22,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:03:22,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39031,1676171000966 in 356 msec 2023-02-12 03:03:22,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:03:22,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 563 msec 2023-02-12 03:03:22,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 847 msec 2023-02-12 03:03:22,986 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171001081, completionTime=-1 2023-02-12 03:03:22,986 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:03:22,986 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:03:23,056 DEBUG [hconnection-0x6110a227-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:23,060 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:23,079 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:03:23,079 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171063079 2023-02-12 03:03:23,079 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171123079 2023-02-12 03:03:23,079 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 92 msec 2023-02-12 03:03:23,106 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44827,1676170999687-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:23,107 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44827,1676170999687-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:23,107 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44827,1676170999687-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:23,109 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:44827, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:23,110 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:23,117 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:03:23,132 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:03:23,134 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:23,148 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:03:23,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:23,155 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:23,184 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,186 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16 empty. 2023-02-12 03:03:23,187 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,188 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:03:23,219 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:23,222 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77723931fc6a62c8b723ee4f0b073d16, NAME => 'hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:23,241 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:23,241 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 77723931fc6a62c8b723ee4f0b073d16, disabling compactions & flushes 2023-02-12 03:03:23,241 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,241 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. after waiting 0 ms 2023-02-12 03:03:23,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,242 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,242 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 77723931fc6a62c8b723ee4f0b073d16: Waiting for close lock at 1676171003241Disabling compacts and flushes for region at 1676171003241Disabling writes for close at 1676171003242 (+1 ms)Writing region close event to WAL at 1676171003242Closed at 1676171003242 2023-02-12 03:03:23,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:23,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171003250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171003250"}]},"ts":"1676171003250"} 2023-02-12 03:03:23,293 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:23,295 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:23,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171003295"}]},"ts":"1676171003295"} 2023-02-12 03:03:23,306 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:03:23,311 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:23,313 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:23,313 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:23,313 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:23,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=77723931fc6a62c8b723ee4f0b073d16, ASSIGN}] 2023-02-12 03:03:23,319 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=77723931fc6a62c8b723ee4f0b073d16, ASSIGN 2023-02-12 03:03:23,321 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=77723931fc6a62c8b723ee4f0b073d16, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:23,473 INFO [jenkins-hbase6:44827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:23,475 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=77723931fc6a62c8b723ee4f0b073d16, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:23,475 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171003474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171003474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171003474"}]},"ts":"1676171003474"} 2023-02-12 03:03:23,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 77723931fc6a62c8b723ee4f0b073d16, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:23,540 INFO [RS:1;jenkins-hbase6:34483] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C34483%2C1676171001018, suffix=, logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,34483,1676171001018, archiveDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs, maxLogs=32 2023-02-12 03:03:23,541 INFO [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39031%2C1676171000966, suffix=, logDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,39031,1676171000966, archiveDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs, maxLogs=32 2023-02-12 03:03:23,569 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK] 2023-02-12 03:03:23,570 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK] 2023-02-12 03:03:23,571 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK] 2023-02-12 03:03:23,572 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK] 2023-02-12 03:03:23,576 INFO [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,39031,1676171000966/jenkins-hbase6.apache.org%2C39031%2C1676171000966.1676171003543 2023-02-12 03:03:23,576 DEBUG [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK], DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK]] 2023-02-12 03:03:23,578 INFO [RS:1;jenkins-hbase6:34483] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/WALs/jenkins-hbase6.apache.org,34483,1676171001018/jenkins-hbase6.apache.org%2C34483%2C1676171001018.1676171003543 2023-02-12 03:03:23,582 DEBUG [RS:1;jenkins-hbase6:34483] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42595,DS-4ce842c2-3a11-47bf-bcd7-605bbab6dda6,DISK], DatanodeInfoWithStorage[127.0.0.1:37287,DS-1e727f1b-3aa7-4c1f-97e1-f2755ba75ec1,DISK]] 2023-02-12 03:03:23,635 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:23,636 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:23,639 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:23,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77723931fc6a62c8b723ee4f0b073d16, NAME => 'hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:23,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:23,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,649 INFO [StoreOpener-77723931fc6a62c8b723ee4f0b073d16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,652 DEBUG [StoreOpener-77723931fc6a62c8b723ee4f0b073d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/info 2023-02-12 03:03:23,652 DEBUG [StoreOpener-77723931fc6a62c8b723ee4f0b073d16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/info 2023-02-12 03:03:23,652 INFO [StoreOpener-77723931fc6a62c8b723ee4f0b073d16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77723931fc6a62c8b723ee4f0b073d16 columnFamilyName info 2023-02-12 03:03:23,653 INFO [StoreOpener-77723931fc6a62c8b723ee4f0b073d16-1] regionserver.HStore(310): Store=77723931fc6a62c8b723ee4f0b073d16/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:23,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:23,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:23,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 77723931fc6a62c8b723ee4f0b073d16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72007186, jitterRate=0.07299068570137024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:23,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 77723931fc6a62c8b723ee4f0b073d16: Running coprocessor pre-open hook at 1676171003647Writing region info on filesystem at 1676171003647Initializing all the Stores at 1676171003649 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171003649Cleaning up temporary data from old regions at 1676171003657 (+8 ms)Cleaning up detritus from prior splits at 1676171003657Running coprocessor post-open hooks at 1676171003665 (+8 ms)Region opened successfully at 1676171003665 2023-02-12 03:03:23,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16., pid=6, masterSystemTime=1676171003635 2023-02-12 03:03:23,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:23,675 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=77723931fc6a62c8b723ee4f0b073d16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:23,675 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171003674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171003674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171003674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171003674"}]},"ts":"1676171003674"} 2023-02-12 03:03:23,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:03:23,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 77723931fc6a62c8b723ee4f0b073d16, server=jenkins-hbase6.apache.org,34483,1676171001018 in 201 msec 2023-02-12 03:03:23,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:03:23,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=77723931fc6a62c8b723ee4f0b073d16, ASSIGN in 370 msec 2023-02-12 03:03:23,692 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:23,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171003692"}]},"ts":"1676171003692"} 2023-02-12 03:03:23,696 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:03:23,700 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:23,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 565 msec 2023-02-12 03:03:23,751 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:03:23,752 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:23,752 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:23,776 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:23,778 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:23,793 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:03:23,817 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:23,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 39 msec 2023-02-12 03:03:23,838 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:03:23,852 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:23,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-02-12 03:03:23,867 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:03:23,870 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:03:23,870 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.776sec 2023-02-12 03:03:23,874 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:03:23,876 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:03:23,876 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:03:23,878 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44827,1676170999687-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:03:23,880 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44827,1676170999687-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:03:23,891 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:03:23,957 DEBUG [Listener at localhost/42187] zookeeper.ReadOnlyZKClient(139): Connect 0x484cbfec to 127.0.0.1:58721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:23,963 DEBUG [Listener at localhost/42187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d1d9795, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:24,014 DEBUG [hconnection-0x3db2b7b1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:24,028 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:24,038 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:24,039 DEBUG [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:03:24,048 DEBUG [Listener at localhost/42187] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:03:24,052 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:03:24,056 INFO [Listener at localhost/42187] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 03:03:24,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-12 03:03:24,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:03:24,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.2.20:48458 deadline: 1676171064060, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 03:03:24,081 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 03:03:24,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:24,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 03:03:24,101 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:24,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:24,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 03:03:24,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:24,129 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,129 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,129 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,129 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,130 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,130 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,130 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,130 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 empty. 2023-02-12 03:03:24,131 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be empty. 2023-02-12 03:03:24,131 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 empty. 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d empty. 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c empty. 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a empty. 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c empty. 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,135 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 empty. 2023-02-12 03:03:24,135 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,135 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,135 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 empty. 2023-02-12 03:03:24,134 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,133 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 empty. 2023-02-12 03:03:24,139 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,139 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,139 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 03:03:24,159 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:24,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08b8c2eefb84f4c836e45fb106402386, NAME => 'testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 803b24e2afa27cd17b40934b13589e6c, NAME => 'testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a599c2b0174841591718759ffc2587f6, NAME => 'testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 08b8c2eefb84f4c836e45fb106402386, disabling compactions & flushes 2023-02-12 03:03:24,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. after waiting 0 ms 2023-02-12 03:03:24,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,206 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,206 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 08b8c2eefb84f4c836e45fb106402386: Waiting for close lock at 1676171004206Disabling compacts and flushes for region at 1676171004206Disabling writes for close at 1676171004206Writing region close event to WAL at 1676171004206Closed at 1676171004206 2023-02-12 03:03:24,207 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 659e0262708e2e98371eaa6dd27372d2, NAME => 'testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,210 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,210 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,212 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 803b24e2afa27cd17b40934b13589e6c, disabling compactions & flushes 2023-02-12 03:03:24,212 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a599c2b0174841591718759ffc2587f6, disabling compactions & flushes 2023-02-12 03:03:24,212 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,212 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,212 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. after waiting 0 ms 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. after waiting 0 ms 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,213 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,213 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 803b24e2afa27cd17b40934b13589e6c: Waiting for close lock at 1676171004212Disabling compacts and flushes for region at 1676171004212Disabling writes for close at 1676171004213 (+1 ms)Writing region close event to WAL at 1676171004213Closed at 1676171004213 2023-02-12 03:03:24,213 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a599c2b0174841591718759ffc2587f6: Waiting for close lock at 1676171004212Disabling compacts and flushes for region at 1676171004212Disabling writes for close at 1676171004213 (+1 ms)Writing region close event to WAL at 1676171004213Closed at 1676171004213 2023-02-12 03:03:24,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 619c7547d9d50bf8bd9bec1a5e9a9982, NAME => 'testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,216 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e970f37f3bea46f73188a99d5dfdae6d, NAME => 'testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:24,234 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 659e0262708e2e98371eaa6dd27372d2, disabling compactions & flushes 2023-02-12 03:03:24,235 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. after waiting 0 ms 2023-02-12 03:03:24,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,235 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,235 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 659e0262708e2e98371eaa6dd27372d2: Waiting for close lock at 1676171004235Disabling compacts and flushes for region at 1676171004235Disabling writes for close at 1676171004235Writing region close event to WAL at 1676171004235Closed at 1676171004235 2023-02-12 03:03:24,236 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => eef95a0c5bc7339cb77860d544dc9e5a, NAME => 'testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e970f37f3bea46f73188a99d5dfdae6d, disabling compactions & flushes 2023-02-12 03:03:24,259 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 619c7547d9d50bf8bd9bec1a5e9a9982, disabling compactions & flushes 2023-02-12 03:03:24,259 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,260 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,260 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,260 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,260 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. after waiting 0 ms 2023-02-12 03:03:24,260 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,260 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,260 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. after waiting 0 ms 2023-02-12 03:03:24,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e970f37f3bea46f73188a99d5dfdae6d: Waiting for close lock at 1676171004259Disabling compacts and flushes for region at 1676171004259Disabling writes for close at 1676171004260 (+1 ms)Writing region close event to WAL at 1676171004260Closed at 1676171004260 2023-02-12 03:03:24,261 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,262 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,262 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Waiting for close lock at 1676171004259Disabling compacts and flushes for region at 1676171004259Disabling writes for close at 1676171004261 (+2 ms)Writing region close event to WAL at 1676171004262 (+1 ms)Closed at 1676171004262 2023-02-12 03:03:24,264 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7a942cbce2c213cc475cee5c2f1052be, NAME => 'testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,264 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ab86bdcbc077f8bc22a27b110eff135c, NAME => 'testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,271 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing eef95a0c5bc7339cb77860d544dc9e5a, disabling compactions & flushes 2023-02-12 03:03:24,271 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. after waiting 0 ms 2023-02-12 03:03:24,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,272 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,272 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for eef95a0c5bc7339cb77860d544dc9e5a: Waiting for close lock at 1676171004271Disabling compacts and flushes for region at 1676171004271Disabling writes for close at 1676171004272 (+1 ms)Writing region close event to WAL at 1676171004272Closed at 1676171004272 2023-02-12 03:03:24,273 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f0b9975c4a68468dd3073b40446983e6, NAME => 'testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp 2023-02-12 03:03:24,292 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7a942cbce2c213cc475cee5c2f1052be, disabling compactions & flushes 2023-02-12 03:03:24,326 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. after waiting 0 ms 2023-02-12 03:03:24,326 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,327 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,327 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7a942cbce2c213cc475cee5c2f1052be: Waiting for close lock at 1676171004326Disabling compacts and flushes for region at 1676171004326Disabling writes for close at 1676171004326Writing region close event to WAL at 1676171004327 (+1 ms)Closed at 1676171004327 2023-02-12 03:03:24,327 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ab86bdcbc077f8bc22a27b110eff135c, disabling compactions & flushes 2023-02-12 03:03:24,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. after waiting 0 ms 2023-02-12 03:03:24,330 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,330 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,331 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ab86bdcbc077f8bc22a27b110eff135c: Waiting for close lock at 1676171004330Disabling compacts and flushes for region at 1676171004330Disabling writes for close at 1676171004330Writing region close event to WAL at 1676171004330Closed at 1676171004330 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f0b9975c4a68468dd3073b40446983e6, disabling compactions & flushes 2023-02-12 03:03:24,338 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. after waiting 0 ms 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,338 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,338 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f0b9975c4a68468dd3073b40446983e6: Waiting for close lock at 1676171004338Disabling compacts and flushes for region at 1676171004338Disabling writes for close at 1676171004338Writing region close event to WAL at 1676171004338Closed at 1676171004338 2023-02-12 03:03:24,343 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:24,345 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,345 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,345 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,346 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171004345"}]},"ts":"1676171004345"} 2023-02-12 03:03:24,395 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 03:03:24,397 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:24,397 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171004397"}]},"ts":"1676171004397"} 2023-02-12 03:03:24,400 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 03:03:24,404 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:24,417 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:24,417 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:24,418 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:24,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, ASSIGN}] 2023-02-12 03:03:24,422 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, ASSIGN 2023-02-12 03:03:24,423 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, ASSIGN 2023-02-12 03:03:24,423 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, ASSIGN 2023-02-12 03:03:24,423 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, ASSIGN 2023-02-12 03:03:24,425 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:24,425 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, ASSIGN 2023-02-12 03:03:24,425 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39031,1676171000966; forceNewPlan=false, retain=false 2023-02-12 03:03:24,425 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:24,425 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39031,1676171000966; forceNewPlan=false, retain=false 2023-02-12 03:03:24,426 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, ASSIGN 2023-02-12 03:03:24,426 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39031,1676171000966; forceNewPlan=false, retain=false 2023-02-12 03:03:24,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, ASSIGN 2023-02-12 03:03:24,427 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, ASSIGN 2023-02-12 03:03:24,427 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, ASSIGN 2023-02-12 03:03:24,428 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:24,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39031,1676171000966; forceNewPlan=false, retain=false 2023-02-12 03:03:24,428 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:24,428 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39031,1676171000966; forceNewPlan=false, retain=false 2023-02-12 03:03:24,428 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, ASSIGN 2023-02-12 03:03:24,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,34483,1676171001018; forceNewPlan=false, retain=false 2023-02-12 03:03:24,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:24,575 INFO [jenkins-hbase6:44827] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 03:03:24,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e970f37f3bea46f73188a99d5dfdae6d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,578 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08b8c2eefb84f4c836e45fb106402386, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,578 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=eef95a0c5bc7339cb77860d544dc9e5a, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a599c2b0174841591718759ffc2587f6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,579 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004578"}]},"ts":"1676171004578"} 2023-02-12 03:03:24,579 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004578"}]},"ts":"1676171004578"} 2023-02-12 03:03:24,579 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004578"}]},"ts":"1676171004578"} 2023-02-12 03:03:24,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ab86bdcbc077f8bc22a27b110eff135c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,579 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004578"}]},"ts":"1676171004578"} 2023-02-12 03:03:24,579 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004578"}]},"ts":"1676171004578"} 2023-02-12 03:03:24,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure e970f37f3bea46f73188a99d5dfdae6d, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:24,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure eef95a0c5bc7339cb77860d544dc9e5a, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:24,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure a599c2b0174841591718759ffc2587f6, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:24,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure 08b8c2eefb84f4c836e45fb106402386, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:24,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f0b9975c4a68468dd3073b40446983e6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure ab86bdcbc077f8bc22a27b110eff135c, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:24,589 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004588"}]},"ts":"1676171004588"} 2023-02-12 03:03:24,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=803b24e2afa27cd17b40934b13589e6c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004590"}]},"ts":"1676171004590"} 2023-02-12 03:03:24,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure f0b9975c4a68468dd3073b40446983e6, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:24,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=659e0262708e2e98371eaa6dd27372d2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004594"}]},"ts":"1676171004594"} 2023-02-12 03:03:24,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 803b24e2afa27cd17b40934b13589e6c, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:24,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7a942cbce2c213cc475cee5c2f1052be, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=619c7547d9d50bf8bd9bec1a5e9a9982, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004597"}]},"ts":"1676171004597"} 2023-02-12 03:03:24,597 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171004597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171004597"}]},"ts":"1676171004597"} 2023-02-12 03:03:24,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure 659e0262708e2e98371eaa6dd27372d2, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:24,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 7a942cbce2c213cc475cee5c2f1052be, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:24,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 619c7547d9d50bf8bd9bec1a5e9a9982, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:24,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:24,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e970f37f3bea46f73188a99d5dfdae6d, NAME => 'testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 03:03:24,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a942cbce2c213cc475cee5c2f1052be, NAME => 'testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 03:03:24,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,784 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,784 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,786 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1 2023-02-12 03:03:24,786 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1 2023-02-12 03:03:24,786 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1 2023-02-12 03:03:24,786 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1 2023-02-12 03:03:24,786 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e970f37f3bea46f73188a99d5dfdae6d columnFamilyName f1 2023-02-12 03:03:24,787 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a942cbce2c213cc475cee5c2f1052be columnFamilyName f1 2023-02-12 03:03:24,787 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(310): Store=e970f37f3bea46f73188a99d5dfdae6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,788 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,788 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(310): Store=7a942cbce2c213cc475cee5c2f1052be/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,789 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,791 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2 2023-02-12 03:03:24,791 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2 2023-02-12 03:03:24,791 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2 2023-02-12 03:03:24,791 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2 2023-02-12 03:03:24,791 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e970f37f3bea46f73188a99d5dfdae6d columnFamilyName f2 2023-02-12 03:03:24,791 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a942cbce2c213cc475cee5c2f1052be columnFamilyName f2 2023-02-12 03:03:24,792 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(310): Store=e970f37f3bea46f73188a99d5dfdae6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,793 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(310): Store=7a942cbce2c213cc475cee5c2f1052be/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:24,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:24,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened e970f37f3bea46f73188a99d5dfdae6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68978318, jitterRate=0.027857035398483276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for e970f37f3bea46f73188a99d5dfdae6d: Running coprocessor pre-open hook at 1676171004781Writing region info on filesystem at 1676171004781Initializing all the Stores at 1676171004783 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004783Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004783Cleaning up temporary data from old regions at 1676171004797 (+14 ms)Cleaning up detritus from prior splits at 1676171004798 (+1 ms)Running coprocessor post-open hooks at 1676171004807 (+9 ms)Region opened successfully at 1676171004807 2023-02-12 03:03:24,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 7a942cbce2c213cc475cee5c2f1052be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66626487, jitterRate=-0.007187977433204651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 7a942cbce2c213cc475cee5c2f1052be: Running coprocessor pre-open hook at 1676171004781Writing region info on filesystem at 1676171004781Initializing all the Stores at 1676171004783 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004783Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004783Cleaning up temporary data from old regions at 1676171004798 (+15 ms)Cleaning up detritus from prior splits at 1676171004799 (+1 ms)Running coprocessor post-open hooks at 1676171004809 (+10 ms)Region opened successfully at 1676171004809 2023-02-12 03:03:24,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d., pid=21, masterSystemTime=1676171004748 2023-02-12 03:03:24,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be., pid=29, masterSystemTime=1676171004748 2023-02-12 03:03:24,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:24,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eef95a0c5bc7339cb77860d544dc9e5a, NAME => 'testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 03:03:24,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e970f37f3bea46f73188a99d5dfdae6d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004815"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004815"}]},"ts":"1676171004815"} 2023-02-12 03:03:24,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:24,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=7a942cbce2c213cc475cee5c2f1052be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 659e0262708e2e98371eaa6dd27372d2, NAME => 'testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 03:03:24,818 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004817"}]},"ts":"1676171004817"} 2023-02-12 03:03:24,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,820 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,822 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,823 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1 2023-02-12 03:03:24,824 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1 2023-02-12 03:03:24,824 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eef95a0c5bc7339cb77860d544dc9e5a columnFamilyName f1 2023-02-12 03:03:24,825 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1 2023-02-12 03:03:24,825 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1 2023-02-12 03:03:24,825 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 659e0262708e2e98371eaa6dd27372d2 columnFamilyName f1 2023-02-12 03:03:24,825 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(310): Store=eef95a0c5bc7339cb77860d544dc9e5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,826 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-12 03:03:24,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure e970f37f3bea46f73188a99d5dfdae6d, server=jenkins-hbase6.apache.org,39031,1676171000966 in 238 msec 2023-02-12 03:03:24,827 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(310): Store=659e0262708e2e98371eaa6dd27372d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,827 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-12 03:03:24,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 7a942cbce2c213cc475cee5c2f1052be, server=jenkins-hbase6.apache.org,34483,1676171001018 in 218 msec 2023-02-12 03:03:24,830 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2 2023-02-12 03:03:24,830 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2 2023-02-12 03:03:24,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, ASSIGN in 409 msec 2023-02-12 03:03:24,830 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2 2023-02-12 03:03:24,830 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eef95a0c5bc7339cb77860d544dc9e5a columnFamilyName f2 2023-02-12 03:03:24,831 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(310): Store=eef95a0c5bc7339cb77860d544dc9e5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, ASSIGN in 411 msec 2023-02-12 03:03:24,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,830 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2 2023-02-12 03:03:24,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,836 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 659e0262708e2e98371eaa6dd27372d2 columnFamilyName f2 2023-02-12 03:03:24,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,837 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(310): Store=659e0262708e2e98371eaa6dd27372d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:24,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened eef95a0c5bc7339cb77860d544dc9e5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61653673, jitterRate=-0.08128868043422699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for eef95a0c5bc7339cb77860d544dc9e5a: Running coprocessor pre-open hook at 1676171004817Writing region info on filesystem at 1676171004817Initializing all the Stores at 1676171004819 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004819Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004820 (+1 ms)Cleaning up temporary data from old regions at 1676171004836 (+16 ms)Cleaning up detritus from prior splits at 1676171004836Running coprocessor post-open hooks at 1676171004848 (+12 ms)Region opened successfully at 1676171004848 2023-02-12 03:03:24,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:24,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a., pid=22, masterSystemTime=1676171004748 2023-02-12 03:03:24,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 659e0262708e2e98371eaa6dd27372d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59203026, jitterRate=-0.11780616641044617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 659e0262708e2e98371eaa6dd27372d2: Running coprocessor pre-open hook at 1676171004818Writing region info on filesystem at 1676171004818Initializing all the Stores at 1676171004820 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004820Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004822 (+2 ms)Cleaning up temporary data from old regions at 1676171004843 (+21 ms)Cleaning up detritus from prior splits at 1676171004845 (+2 ms)Running coprocessor post-open hooks at 1676171004853 (+8 ms)Region opened successfully at 1676171004853 2023-02-12 03:03:24,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:24,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08b8c2eefb84f4c836e45fb106402386, NAME => 'testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 03:03:24,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,854 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=eef95a0c5bc7339cb77860d544dc9e5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,854 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004854"}]},"ts":"1676171004854"} 2023-02-12 03:03:24,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2., pid=28, masterSystemTime=1676171004748 2023-02-12 03:03:24,857 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:24,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f0b9975c4a68468dd3073b40446983e6, NAME => 'testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 03:03:24,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,858 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=659e0262708e2e98371eaa6dd27372d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,859 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004858"}]},"ts":"1676171004858"} 2023-02-12 03:03:24,859 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f1 2023-02-12 03:03:24,859 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f1 2023-02-12 03:03:24,860 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b8c2eefb84f4c836e45fb106402386 columnFamilyName f1 2023-02-12 03:03:24,861 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,861 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(310): Store=08b8c2eefb84f4c836e45fb106402386/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,861 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-12 03:03:24,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure eef95a0c5bc7339cb77860d544dc9e5a, server=jenkins-hbase6.apache.org,39031,1676171000966 in 274 msec 2023-02-12 03:03:24,864 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f1 2023-02-12 03:03:24,864 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f1 2023-02-12 03:03:24,864 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f2 2023-02-12 03:03:24,864 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f2 2023-02-12 03:03:24,864 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0b9975c4a68468dd3073b40446983e6 columnFamilyName f1 2023-02-12 03:03:24,864 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b8c2eefb84f4c836e45fb106402386 columnFamilyName f2 2023-02-12 03:03:24,865 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(310): Store=08b8c2eefb84f4c836e45fb106402386/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,865 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(310): Store=f0b9975c4a68468dd3073b40446983e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-12 03:03:24,866 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure 659e0262708e2e98371eaa6dd27372d2, server=jenkins-hbase6.apache.org,34483,1676171001018 in 265 msec 2023-02-12 03:03:24,866 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, ASSIGN in 445 msec 2023-02-12 03:03:24,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,869 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f2 2023-02-12 03:03:24,869 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f2 2023-02-12 03:03:24,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, ASSIGN in 448 msec 2023-02-12 03:03:24,869 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0b9975c4a68468dd3073b40446983e6 columnFamilyName f2 2023-02-12 03:03:24,870 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(310): Store=f0b9975c4a68468dd3073b40446983e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:24,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:24,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 08b8c2eefb84f4c836e45fb106402386; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73776116, jitterRate=0.09934979677200317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 08b8c2eefb84f4c836e45fb106402386: Running coprocessor pre-open hook at 1676171004854Writing region info on filesystem at 1676171004854Initializing all the Stores at 1676171004856 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004856Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004857 (+1 ms)Cleaning up temporary data from old regions at 1676171004869 (+12 ms)Cleaning up detritus from prior splits at 1676171004871 (+2 ms)Running coprocessor post-open hooks at 1676171004879 (+8 ms)Region opened successfully at 1676171004879 2023-02-12 03:03:24,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386., pid=24, masterSystemTime=1676171004748 2023-02-12 03:03:24,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened f0b9975c4a68468dd3073b40446983e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75489742, jitterRate=0.12488481402397156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for f0b9975c4a68468dd3073b40446983e6: Running coprocessor pre-open hook at 1676171004858Writing region info on filesystem at 1676171004858Initializing all the Stores at 1676171004860 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004860Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004861 (+1 ms)Cleaning up temporary data from old regions at 1676171004874 (+13 ms)Cleaning up detritus from prior splits at 1676171004874Running coprocessor post-open hooks at 1676171004882 (+8 ms)Region opened successfully at 1676171004882 2023-02-12 03:03:24,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6., pid=26, masterSystemTime=1676171004748 2023-02-12 03:03:24,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:24,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a599c2b0174841591718759ffc2587f6, NAME => 'testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 03:03:24,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08b8c2eefb84f4c836e45fb106402386, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004885"}]},"ts":"1676171004885"} 2023-02-12 03:03:24,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:24,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 619c7547d9d50bf8bd9bec1a5e9a9982, NAME => 'testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 03:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,888 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f0b9975c4a68468dd3073b40446983e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,889 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171004888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004888"}]},"ts":"1676171004888"} 2023-02-12 03:03:24,891 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,891 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1 2023-02-12 03:03:24,891 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1 2023-02-12 03:03:24,892 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a599c2b0174841591718759ffc2587f6 columnFamilyName f1 2023-02-12 03:03:24,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-12 03:03:24,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure 08b8c2eefb84f4c836e45fb106402386, server=jenkins-hbase6.apache.org,39031,1676171000966 in 302 msec 2023-02-12 03:03:24,893 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(310): Store=a599c2b0174841591718759ffc2587f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,893 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,894 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1 2023-02-12 03:03:24,894 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1 2023-02-12 03:03:24,895 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619c7547d9d50bf8bd9bec1a5e9a9982 columnFamilyName f1 2023-02-12 03:03:24,896 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(310): Store=619c7547d9d50bf8bd9bec1a5e9a9982/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,896 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-12 03:03:24,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure f0b9975c4a68468dd3073b40446983e6, server=jenkins-hbase6.apache.org,34483,1676171001018 in 299 msec 2023-02-12 03:03:24,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, ASSIGN in 475 msec 2023-02-12 03:03:24,898 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2 2023-02-12 03:03:24,898 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2 2023-02-12 03:03:24,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, ASSIGN in 478 msec 2023-02-12 03:03:24,899 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619c7547d9d50bf8bd9bec1a5e9a9982 columnFamilyName f2 2023-02-12 03:03:24,899 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(310): Store=619c7547d9d50bf8bd9bec1a5e9a9982/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,900 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2 2023-02-12 03:03:24,900 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2 2023-02-12 03:03:24,901 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a599c2b0174841591718759ffc2587f6 columnFamilyName f2 2023-02-12 03:03:24,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,902 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(310): Store=a599c2b0174841591718759ffc2587f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:24,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:24,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 619c7547d9d50bf8bd9bec1a5e9a9982; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65066962, jitterRate=-0.030426710844039917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Running coprocessor pre-open hook at 1676171004889Writing region info on filesystem at 1676171004889Initializing all the Stores at 1676171004890 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004890Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004890Cleaning up temporary data from old regions at 1676171004904 (+14 ms)Cleaning up detritus from prior splits at 1676171004904Running coprocessor post-open hooks at 1676171004912 (+8 ms)Region opened successfully at 1676171004912 2023-02-12 03:03:24,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened a599c2b0174841591718759ffc2587f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65645723, jitterRate=-0.021802499890327454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for a599c2b0174841591718759ffc2587f6: Running coprocessor pre-open hook at 1676171004885Writing region info on filesystem at 1676171004885Initializing all the Stores at 1676171004888 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004888Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004888Cleaning up temporary data from old regions at 1676171004906 (+18 ms)Cleaning up detritus from prior splits at 1676171004906Running coprocessor post-open hooks at 1676171004914 (+8 ms)Region opened successfully at 1676171004914 2023-02-12 03:03:24,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982., pid=30, masterSystemTime=1676171004748 2023-02-12 03:03:24,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6., pid=23, masterSystemTime=1676171004748 2023-02-12 03:03:24,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:24,918 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=619c7547d9d50bf8bd9bec1a5e9a9982, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,919 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004918"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004918"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004918"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004918"}]},"ts":"1676171004918"} 2023-02-12 03:03:24,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 803b24e2afa27cd17b40934b13589e6c, NAME => 'testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 03:03:24,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:24,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ab86bdcbc077f8bc22a27b110eff135c, NAME => 'testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,922 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a599c2b0174841591718759ffc2587f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,922 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004921"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004921"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004921"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004921"}]},"ts":"1676171004921"} 2023-02-12 03:03:24,922 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,923 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,925 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1 2023-02-12 03:03:24,925 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1 2023-02-12 03:03:24,926 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1 2023-02-12 03:03:24,926 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1 2023-02-12 03:03:24,926 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab86bdcbc077f8bc22a27b110eff135c columnFamilyName f1 2023-02-12 03:03:24,927 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803b24e2afa27cd17b40934b13589e6c columnFamilyName f1 2023-02-12 03:03:24,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-12 03:03:24,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 619c7547d9d50bf8bd9bec1a5e9a9982, server=jenkins-hbase6.apache.org,34483,1676171001018 in 316 msec 2023-02-12 03:03:24,928 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(310): Store=803b24e2afa27cd17b40934b13589e6c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,929 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-12 03:03:24,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure a599c2b0174841591718759ffc2587f6, server=jenkins-hbase6.apache.org,39031,1676171000966 in 340 msec 2023-02-12 03:03:24,930 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(310): Store=ab86bdcbc077f8bc22a27b110eff135c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,931 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, ASSIGN in 510 msec 2023-02-12 03:03:24,932 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2 2023-02-12 03:03:24,932 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2 2023-02-12 03:03:24,933 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803b24e2afa27cd17b40934b13589e6c columnFamilyName f2 2023-02-12 03:03:24,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, ASSIGN in 512 msec 2023-02-12 03:03:24,933 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2 2023-02-12 03:03:24,933 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2 2023-02-12 03:03:24,933 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(310): Store=803b24e2afa27cd17b40934b13589e6c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,935 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab86bdcbc077f8bc22a27b110eff135c columnFamilyName f2 2023-02-12 03:03:24,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,935 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(310): Store=ab86bdcbc077f8bc22a27b110eff135c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:24,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:24,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:24,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:24,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 803b24e2afa27cd17b40934b13589e6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66980842, jitterRate=-0.0019076764583587646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 803b24e2afa27cd17b40934b13589e6c: Running coprocessor pre-open hook at 1676171004920Writing region info on filesystem at 1676171004920Initializing all the Stores at 1676171004922 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004922Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004922Cleaning up temporary data from old regions at 1676171004937 (+15 ms)Cleaning up detritus from prior splits at 1676171004938 (+1 ms)Running coprocessor post-open hooks at 1676171004945 (+7 ms)Region opened successfully at 1676171004945 2023-02-12 03:03:24,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:24,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c., pid=27, masterSystemTime=1676171004748 2023-02-12 03:03:24,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened ab86bdcbc077f8bc22a27b110eff135c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60692834, jitterRate=-0.09560629725456238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:24,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for ab86bdcbc077f8bc22a27b110eff135c: Running coprocessor pre-open hook at 1676171004921Writing region info on filesystem at 1676171004921Initializing all the Stores at 1676171004922 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004922Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171004922Cleaning up temporary data from old regions at 1676171004939 (+17 ms)Cleaning up detritus from prior splits at 1676171004940 (+1 ms)Running coprocessor post-open hooks at 1676171004947 (+7 ms)Region opened successfully at 1676171004947 2023-02-12 03:03:24,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c., pid=25, masterSystemTime=1676171004748 2023-02-12 03:03:24,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:24,950 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=803b24e2afa27cd17b40934b13589e6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:24,951 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004950"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004950"}]},"ts":"1676171004950"} 2023-02-12 03:03:24,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:24,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ab86bdcbc077f8bc22a27b110eff135c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:24,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171004951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171004951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171004951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171004951"}]},"ts":"1676171004951"} 2023-02-12 03:03:24,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-12 03:03:24,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 803b24e2afa27cd17b40934b13589e6c, server=jenkins-hbase6.apache.org,34483,1676171001018 in 358 msec 2023-02-12 03:03:24,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-12 03:03:24,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure ab86bdcbc077f8bc22a27b110eff135c, server=jenkins-hbase6.apache.org,39031,1676171000966 in 366 msec 2023-02-12 03:03:24,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, ASSIGN in 539 msec 2023-02-12 03:03:24,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-12 03:03:24,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, ASSIGN in 540 msec 2023-02-12 03:03:24,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:24,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171004963"}]},"ts":"1676171004963"} 2023-02-12 03:03:24,966 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 03:03:24,969 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:24,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 873 msec 2023-02-12 03:03:25,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:25,244 INFO [Listener at localhost/42187] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 03:03:25,244 DEBUG [Listener at localhost/42187] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 03:03:25,247 INFO [Listener at localhost/42187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:25,256 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 03:03:25,257 INFO [Listener at localhost/42187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:25,257 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 03:03:25,257 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:03:25,444 DEBUG [hconnection-0x3db2b7b1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:25,486 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:25,492 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39031] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:25,506 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34483] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:25,842 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:03:25,846 INFO [Listener at localhost/42187] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:03:25,861 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:25,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171005861 (current time:1676171005861). 2023-02-12 03:03:25,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:03:25,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] zookeeper.ReadOnlyZKClient(139): Connect 0x084a5705 to 127.0.0.1:58721 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:25,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46eb5b2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:25,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:25,898 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:25,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x084a5705 to 127.0.0.1:58721 2023-02-12 03:03:25,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:25,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:03:25,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:25,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:25,925 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:25,927 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676171605927 2023-02-12 03:03:25,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:25,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 03:03:25,929 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:25,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:25,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-12 03:03:25,934 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:25,935 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676171605935 2023-02-12 03:03:25,936 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:25,936 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:03:26,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-12 03:03:26,005 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-12 03:03:26,006 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:26,007 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-12 03:03:26,007 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 03:03:26,008 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,008 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,010 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:26,010 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,010 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:26,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:26,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:26,011 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,011 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,012 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 03:03:26,013 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 03:03:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 03:03:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,014 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 03:03:26,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 03:03:26,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 03:03:26,020 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 03:03:26,020 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:26,021 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 03:03:26,021 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:26,021 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:26,022 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 03:03:26,022 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:26,022 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 03:03:26,022 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,34483,1676171001018' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 03:03:26,022 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39031,1676171000966' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 03:03:26,024 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,024 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:26,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:26,025 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,025 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,025 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:26,026 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:26,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:26,026 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,026 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:26,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,34483,1676171001018' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53fac8d[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:26,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39031,1676171000966' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 03:03:26,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53fac8d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:26,032 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 03:03:26,032 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,035 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,036 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:26,036 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:26,036 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,036 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:26,037 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,037 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:26,038 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:26,038 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:26,038 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. started... 2023-02-12 03:03:26,038 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. started... 2023-02-12 03:03:26,039 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:26,039 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. started... 2023-02-12 03:03:26,040 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:26,040 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:26,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:26,041 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:26,040 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:26,041 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:26,040 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:26,040 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:26,040 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7a942cbce2c213cc475cee5c2f1052be 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,041 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. started... 2023-02-12 03:03:26,041 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. started... 2023-02-12 03:03:26,041 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. started... 2023-02-12 03:03:26,044 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 08b8c2eefb84f4c836e45fb106402386: 2023-02-12 03:03:26,045 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2744): Flushing eef95a0c5bc7339cb77860d544dc9e5a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:26,044 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f0b9975c4a68468dd3073b40446983e6: 2023-02-12 03:03:26,044 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 659e0262708e2e98371eaa6dd27372d2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,045 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ab86bdcbc077f8bc22a27b110eff135c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:26,046 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:03:26,046 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,049 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,053 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,053 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,059 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:26,059 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:26,060 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:26,060 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:26,159 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. completed. 2023-02-12 03:03:26,160 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:26,161 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:26,161 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. started... 2023-02-12 03:03:26,162 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 619c7547d9d50bf8bd9bec1a5e9a9982 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,163 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:26,246 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:26,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:26,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:26,248 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:03:26,297 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f1/8244917789014a66b0d3b1bd814b7071 2023-02-12 03:03:26,319 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f1/875ed23e10954226bdd0bfe9f1e83f2d 2023-02-12 03:03:26,324 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f1/203ca1fadb6648e186f3b4c630e01df9 2023-02-12 03:03:26,446 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f2/08e4be0a434748e7a21f358cb3c6fdcf 2023-02-12 03:03:26,465 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f2/b789a64351974f498d644b1513a18b1e 2023-02-12 03:03:26,469 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f2/f537de7000ff4a4586fc0ec3657221a7 2023-02-12 03:03:26,470 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f1/203ca1fadb6648e186f3b4c630e01df9 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9 2023-02-12 03:03:26,476 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f1/8244917789014a66b0d3b1bd814b7071 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071 2023-02-12 03:03:26,481 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,482 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f1/875ed23e10954226bdd0bfe9f1e83f2d as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d 2023-02-12 03:03:26,485 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f2/08e4be0a434748e7a21f358cb3c6fdcf as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf 2023-02-12 03:03:26,486 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:26,490 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f2/b789a64351974f498d644b1513a18b1e as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e 2023-02-12 03:03:26,495 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,496 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,496 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f2/f537de7000ff4a4586fc0ec3657221a7 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7 2023-02-12 03:03:26,498 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 619c7547d9d50bf8bd9bec1a5e9a9982 in 336ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,500 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 03:03:26,502 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 619c7547d9d50bf8bd9bec1a5e9a9982: 2023-02-12 03:03:26,502 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,502 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,503 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9] hfiles 2023-02-12 03:03:26,503 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,507 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf] hfiles 2023-02-12 03:03:26,507 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,508 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:26,510 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ab86bdcbc077f8bc22a27b110eff135c in 465ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,511 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ab86bdcbc077f8bc22a27b110eff135c: 2023-02-12 03:03:26,512 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,512 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071] hfiles 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e] hfiles 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,513 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for eef95a0c5bc7339cb77860d544dc9e5a in 469ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,513 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for eef95a0c5bc7339cb77860d544dc9e5a: 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d] hfiles 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7] hfiles 2023-02-12 03:03:26,514 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,536 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. completed. 2023-02-12 03:03:26,537 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:26,537 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:26,537 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:26,537 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. started... 2023-02-12 03:03:26,538 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 803b24e2afa27cd17b40934b13589e6c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. completed. 2023-02-12 03:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:26,539 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. started... 2023-02-12 03:03:26,540 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e970f37f3bea46f73188a99d5dfdae6d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,541 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. completed. 2023-02-12 03:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:26,547 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. started... 2023-02-12 03:03:26,547 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:26,548 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a599c2b0174841591718759ffc2587f6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:26,549 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:26,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:26,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:26,554 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 03:03:26,555 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. completed. 2023-02-12 03:03:26,555 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:26,555 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:26,575 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f1/b616e7d90fb4494f9a514c6b864432f6 2023-02-12 03:03:26,575 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 2023-02-12 03:03:26,578 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f1/33e1513472144322b25d9b7be304a403 2023-02-12 03:03:26,615 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f2/8b5c623a89b64e039294c0b939641279 2023-02-12 03:03:26,626 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f2/45a00973d663476b96271974ee4c9d7f 2023-02-12 03:03:26,633 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f2/dd97a9dbfe8f428aba0e58689dd2d311 2023-02-12 03:03:26,634 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f1/b616e7d90fb4494f9a514c6b864432f6 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6 2023-02-12 03:03:26,641 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 2023-02-12 03:03:26,643 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f1/33e1513472144322b25d9b7be304a403 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403 2023-02-12 03:03:26,645 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,646 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f2/8b5c623a89b64e039294c0b939641279 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279 2023-02-12 03:03:26,651 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:26,652 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f2/45a00973d663476b96271974ee4c9d7f as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f 2023-02-12 03:03:26,653 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,654 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f2/dd97a9dbfe8f428aba0e58689dd2d311 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311 2023-02-12 03:03:26,655 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,657 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e970f37f3bea46f73188a99d5dfdae6d in 117ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,657 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e970f37f3bea46f73188a99d5dfdae6d: 2023-02-12 03:03:26,657 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,657 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,657 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6] hfiles 2023-02-12 03:03:26,658 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,658 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279] hfiles 2023-02-12 03:03:26,658 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,667 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:26,668 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 803b24e2afa27cd17b40934b13589e6c in 131ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,668 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 803b24e2afa27cd17b40934b13589e6c: 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012] hfiles 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f] hfiles 2023-02-12 03:03:26,669 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,678 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,679 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a599c2b0174841591718759ffc2587f6 in 132ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,679 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a599c2b0174841591718759ffc2587f6: 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403] hfiles 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311] hfiles 2023-02-12 03:03:26,680 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,698 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. completed. 2023-02-12 03:03:26,698 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:26,698 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:26,707 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. completed. 2023-02-12 03:03:26,707 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:26,707 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:26,710 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. completed. 2023-02-12 03:03:26,710 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:26,710 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:26,710 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:26,710 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,710 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 03:03:26,710 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,39031,1676171000966' in zk 2023-02-12 03:03:26,714 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,714 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:26,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:26,714 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:26,714 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 03:03:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,721 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f1/a50e074798a54e8f810bdf94537a06c9 2023-02-12 03:03:26,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,723 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f1/8b2d65c344984a4e930d10b0ec821393 2023-02-12 03:03:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:26,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,39031,1676171000966': 2023-02-12 03:03:26,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39031,1676171000966' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 03:03:26,771 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f2/d9352375cac543e88bd6a360bd16e823 2023-02-12 03:03:26,781 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f1/a50e074798a54e8f810bdf94537a06c9 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9 2023-02-12 03:03:26,789 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,791 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f2/d9352375cac543e88bd6a360bd16e823 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823 2023-02-12 03:03:26,804 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,806 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 659e0262708e2e98371eaa6dd27372d2 in 762ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,806 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 659e0262708e2e98371eaa6dd27372d2: 2023-02-12 03:03:26,806 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,806 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,807 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9] hfiles 2023-02-12 03:03:26,807 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,807 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823] hfiles 2023-02-12 03:03:26,807 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,809 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f2/63086ce1155c494b93c89ea33e61dc3a 2023-02-12 03:03:26,819 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f1/8b2d65c344984a4e930d10b0ec821393 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393 2023-02-12 03:03:26,829 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,831 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f2/63086ce1155c494b93c89ea33e61dc3a as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a 2023-02-12 03:03:26,847 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. completed. 2023-02-12 03:03:26,847 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:26,847 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:26,847 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:26,849 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7a942cbce2c213cc475cee5c2f1052be in 809ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7a942cbce2c213cc475cee5c2f1052be: 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393] hfiles 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393 for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a] hfiles 2023-02-12 03:03:26,849 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a for snapshot=testWithMapReduceMultiRegion 2023-02-12 03:03:26,863 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. completed. 2023-02-12 03:03:26,863 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:26,863 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:26,863 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:26,863 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,863 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 03:03:26,863 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,34483,1676171001018' in zk 2023-02-12 03:03:26,866 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,866 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:26,866 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:26,866 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 03:03:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,34483,1676171001018': 2023-02-12 03:03:26,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,34483,1676171001018' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 03:03:26,871 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-12 03:03:26,871 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:26,871 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:26,871 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-12 03:03:26,871 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:03:26,874 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:26,874 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:26,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:26,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:26,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:26,875 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,876 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,879 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 03:03:26,880 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:26,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,895 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:26,896 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:26,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-12 03:03:26,896 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 03:03:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:26,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:26,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-12 03:03:26,897 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:26,897 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,897 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:26,897 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 03:03:26,897 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 03:03:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:26,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 03:03:27,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-12 03:03:27,055 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:27,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:27,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:27,057 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 03:03:27,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-12 03:03:27,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 03:03:27,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 03:03:27,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676171005928Consolidate snapshot: testWithMapReduceMultiRegion at 1676171006897 (+969 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676171006897Writing data manifest for testWithMapReduceMultiRegion at 1676171006937 (+40 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676171006967 (+30 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676171007077 (+110 ms) 2023-02-12 03:03:27,080 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:27,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1500 sec 2023-02-12 03:03:28,057 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:28,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:28,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:03:28,060 INFO [Listener at localhost/42187] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:03:28,073 INFO [Listener at localhost/42187] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:03:28,085 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:03:28,183 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39031] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:28,185 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34483] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:28,345 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:03:28,364 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:03:28,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 03:03:28,370 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 03:03:28,370 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:28,371 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 03:03:28,371 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 03:03:28,372 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:28,372 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:28,373 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:28,373 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:28,373 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:28,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:28,374 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,374 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:28,375 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:28,375 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:03:28,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:03:28,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:03:28,377 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:03:28,377 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:03:28,377 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:28,377 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:28,378 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:03:28,379 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:03:28,382 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:28,382 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:28,382 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. started... 2023-02-12 03:03:28,383 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:28,383 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:28,383 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:28,383 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 659e0262708e2e98371eaa6dd27372d2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. started... 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. started... 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 08b8c2eefb84f4c836e45fb106402386: 2023-02-12 03:03:28,382 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. started... 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:28,383 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. started... 2023-02-12 03:03:28,383 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. started... 2023-02-12 03:03:28,384 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f0b9975c4a68468dd3073b40446983e6: 2023-02-12 03:03:28,384 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:28,383 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing eef95a0c5bc7339cb77860d544dc9e5a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,383 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7a942cbce2c213cc475cee5c2f1052be 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,383 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:28,384 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. started... 2023-02-12 03:03:28,384 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:28,384 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ab86bdcbc077f8bc22a27b110eff135c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:28,384 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:28,384 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. started... 2023-02-12 03:03:28,384 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e970f37f3bea46f73188a99d5dfdae6d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,385 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 619c7547d9d50bf8bd9bec1a5e9a9982 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,448 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:03:28,455 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f1/866fd634ca374edc80030ff94f941570 2023-02-12 03:03:28,459 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f1/68666c9cec344c5681d2898e3a5d2096 2023-02-12 03:03:28,469 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f1/2e1b3171d70240d39da0358eef8dfc86 2023-02-12 03:03:28,485 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f1/07bd4133dbd64c228646bb42d653f900 2023-02-12 03:03:28,500 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f1/187c78322b2040beba7d12569ebcb28a 2023-02-12 03:03:28,537 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f2/583d724a442f453daeb84325473e5f2c 2023-02-12 03:03:28,546 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f2/d3d8e8b515eb4d68a834a743f0726ed8 2023-02-12 03:03:28,547 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f1/2e1b3171d70240d39da0358eef8dfc86 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/2e1b3171d70240d39da0358eef8dfc86 2023-02-12 03:03:28,547 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f2/25a8717cb75f4bffb4c25a5169ce2f01 2023-02-12 03:03:28,560 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f1/866fd634ca374edc80030ff94f941570 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/866fd634ca374edc80030ff94f941570 2023-02-12 03:03:28,566 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/2e1b3171d70240d39da0358eef8dfc86, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,571 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f2/9f03b3b70406414fac7150ef7459067a 2023-02-12 03:03:28,572 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f1/68666c9cec344c5681d2898e3a5d2096 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/68666c9cec344c5681d2898e3a5d2096 2023-02-12 03:03:28,573 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/.tmp/f2/583d724a442f453daeb84325473e5f2c as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/583d724a442f453daeb84325473e5f2c 2023-02-12 03:03:28,581 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/866fd634ca374edc80030ff94f941570, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,583 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f1/07bd4133dbd64c228646bb42d653f900 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/07bd4133dbd64c228646bb42d653f900 2023-02-12 03:03:28,586 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/.tmp/f2/d3d8e8b515eb4d68a834a743f0726ed8 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/d3d8e8b515eb4d68a834a743f0726ed8 2023-02-12 03:03:28,586 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/68666c9cec344c5681d2898e3a5d2096, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:28,589 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/.tmp/f2/25a8717cb75f4bffb4c25a5169ce2f01 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/25a8717cb75f4bffb4c25a5169ce2f01 2023-02-12 03:03:28,591 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/583d724a442f453daeb84325473e5f2c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,593 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7a942cbce2c213cc475cee5c2f1052be in 210ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,593 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7a942cbce2c213cc475cee5c2f1052be: 2023-02-12 03:03:28,593 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:28,594 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:28,594 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:28,594 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. started... 2023-02-12 03:03:28,594 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 803b24e2afa27cd17b40934b13589e6c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:28,595 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 03:03:28,597 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/07bd4133dbd64c228646bb42d653f900, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,597 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 03:03:28,599 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/.tmp/f2/9f03b3b70406414fac7150ef7459067a as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/9f03b3b70406414fac7150ef7459067a 2023-02-12 03:03:28,604 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/25a8717cb75f4bffb4c25a5169ce2f01, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:28,606 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ab86bdcbc077f8bc22a27b110eff135c in 222ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,606 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ab86bdcbc077f8bc22a27b110eff135c: 2023-02-12 03:03:28,606 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:28,606 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:28,606 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. started... 2023-02-12 03:03:28,606 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:28,607 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a599c2b0174841591718759ffc2587f6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:28,611 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/d3d8e8b515eb4d68a834a743f0726ed8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,613 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for eef95a0c5bc7339cb77860d544dc9e5a in 230ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,613 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for eef95a0c5bc7339cb77860d544dc9e5a: 2023-02-12 03:03:28,613 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:28,613 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:28,614 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/9f03b3b70406414fac7150ef7459067a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,616 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 619c7547d9d50bf8bd9bec1a5e9a9982 in 231ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,616 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 619c7547d9d50bf8bd9bec1a5e9a9982: 2023-02-12 03:03:28,616 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:28,616 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:28,640 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f1/0adf4929dfcf4f4097b8876427463931 2023-02-12 03:03:28,643 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f1/bbe0647a663e4f5dbb3d8c83ed348a6c 2023-02-12 03:03:28,664 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f2/a00c7ef699024986b743874c975af9fe 2023-02-12 03:03:28,668 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f2/a73c4fe7564a45aa9031d0c93cdd1342 2023-02-12 03:03:28,675 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f1/bbe0647a663e4f5dbb3d8c83ed348a6c as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/bbe0647a663e4f5dbb3d8c83ed348a6c 2023-02-12 03:03:28,676 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f1/0adf4929dfcf4f4097b8876427463931 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/0adf4929dfcf4f4097b8876427463931 2023-02-12 03:03:28,683 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/0adf4929dfcf4f4097b8876427463931, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,683 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/bbe0647a663e4f5dbb3d8c83ed348a6c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:28,684 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/.tmp/f2/a73c4fe7564a45aa9031d0c93cdd1342 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/a73c4fe7564a45aa9031d0c93cdd1342 2023-02-12 03:03:28,685 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/.tmp/f2/a00c7ef699024986b743874c975af9fe as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/a00c7ef699024986b743874c975af9fe 2023-02-12 03:03:28,692 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/a00c7ef699024986b743874c975af9fe, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:28,692 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/a73c4fe7564a45aa9031d0c93cdd1342, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,693 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 803b24e2afa27cd17b40934b13589e6c in 99ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,693 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a599c2b0174841591718759ffc2587f6 in 87ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,693 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 803b24e2afa27cd17b40934b13589e6c: 2023-02-12 03:03:28,693 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a599c2b0174841591718759ffc2587f6: 2023-02-12 03:03:28,693 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:28,693 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:28,693 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:28,693 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:28,858 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f1/c0334bb714e24f04936a64c884bc8f08 2023-02-12 03:03:28,874 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f2/e43484a2923a4a06b71e2340dabf05f7 2023-02-12 03:03:28,882 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f1/c0334bb714e24f04936a64c884bc8f08 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/c0334bb714e24f04936a64c884bc8f08 2023-02-12 03:03:28,889 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/c0334bb714e24f04936a64c884bc8f08, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,890 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/.tmp/f2/e43484a2923a4a06b71e2340dabf05f7 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/e43484a2923a4a06b71e2340dabf05f7 2023-02-12 03:03:28,897 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/e43484a2923a4a06b71e2340dabf05f7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,898 INFO [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 659e0262708e2e98371eaa6dd27372d2 in 515ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,898 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 659e0262708e2e98371eaa6dd27372d2: 2023-02-12 03:03:28,898 DEBUG [rs(jenkins-hbase6.apache.org,34483,1676171001018)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:28,898 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:28,898 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:28,898 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,898 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:03:28,898 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,34483,1676171001018' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:03:28,901 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,901 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:28,901 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:28,902 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:28,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:28,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:28,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:28,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:28,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:28,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,34483,1676171001018' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 03:03:28,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e7c412f[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:28,973 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f2/ef50e8eeb9154a2780f50ec8373d1b30 2023-02-12 03:03:28,981 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f1/187c78322b2040beba7d12569ebcb28a as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/187c78322b2040beba7d12569ebcb28a 2023-02-12 03:03:28,987 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/187c78322b2040beba7d12569ebcb28a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,988 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/.tmp/f2/ef50e8eeb9154a2780f50ec8373d1b30 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/ef50e8eeb9154a2780f50ec8373d1b30 2023-02-12 03:03:28,995 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/ef50e8eeb9154a2780f50ec8373d1b30, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:28,996 INFO [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e970f37f3bea46f73188a99d5dfdae6d in 612ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:28,996 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e970f37f3bea46f73188a99d5dfdae6d: 2023-02-12 03:03:28,996 DEBUG [rs(jenkins-hbase6.apache.org,39031,1676171000966)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:28,996 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:28,996 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:28,996 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:28,996 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:03:28,996 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39031,1676171000966' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:03:28,998 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:28,998 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:28,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:28,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:28,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:28,999 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:28,999 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:29,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,39031,1676171000966' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 03:03:29,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e7c412f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:29,001 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 03:03:29,001 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,004 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,004 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:03:29,005 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,34483,1676171001018' in zk 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:03:29,005 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,39031,1676171000966' in zk 2023-02-12 03:03:29,005 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,005 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:29,007 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:03:29,007 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,007 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:29,007 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:03:29,008 DEBUG [member: 'jenkins-hbase6.apache.org,34483,1676171001018' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:03:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:29,008 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,008 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:29,008 DEBUG [member: 'jenkins-hbase6.apache.org,39031,1676171000966' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:03:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:29,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,34483,1676171001018': 2023-02-12 03:03:29,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,34483,1676171001018' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 03:03:29,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:29,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:29,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:29,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:29,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:29,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,39031,1676171000966': 2023-02-12 03:03:29,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,39031,1676171000966' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 03:03:29,018 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 03:03:29,018 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:29,018 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:29,018 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 03:03:29,018 INFO [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:03:29,021 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:29,021 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,022 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,025 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:29,025 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:29,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:29,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:29,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:29,031 DEBUG [(jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:29,032 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:29,031 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 03:03:29,031 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:29,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:03:29,032 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:29,033 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,033 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:29,033 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:29,033 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:29,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:29,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:29,035 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:29,035 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:03:29,135 DEBUG [Listener at localhost/42187] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:03:29,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:03:29,247 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop-4872004316078879802.jar 2023-02-12 03:03:29,263 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676171005861 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:29,264 DEBUG [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce 2023-02-12 03:03:29,265 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:29,265 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:29,265 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:29,265 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(239): region to add: 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=eef95a0c5bc7339cb77860d544dc9e5a as eef95a0c5bc7339cb77860d544dc9e5a in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=08b8c2eefb84f4c836e45fb106402386 as 08b8c2eefb84f4c836e45fb106402386 in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,266 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=7a942cbce2c213cc475cee5c2f1052be as 7a942cbce2c213cc475cee5c2f1052be in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=659e0262708e2e98371eaa6dd27372d2 as 659e0262708e2e98371eaa6dd27372d2 in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=f0b9975c4a68468dd3073b40446983e6 as f0b9975c4a68468dd3073b40446983e6 in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=619c7547d9d50bf8bd9bec1a5e9a9982 as 619c7547d9d50bf8bd9bec1a5e9a9982 in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=ab86bdcbc077f8bc22a27b110eff135c as ab86bdcbc077f8bc22a27b110eff135c in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=a599c2b0174841591718759ffc2587f6 as a599c2b0174841591718759ffc2587f6 in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=e970f37f3bea46f73188a99d5dfdae6d as e970f37f3bea46f73188a99d5dfdae6d in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,267 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(585): clone region=803b24e2afa27cd17b40934b13589e6c as 803b24e2afa27cd17b40934b13589e6c in snapshot testWithMapReduceMultiRegion 2023-02-12 03:03:29,270 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a599c2b0174841591718759ffc2587f6, NAME => 'testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,270 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => eef95a0c5bc7339cb77860d544dc9e5a, NAME => 'testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,270 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => ab86bdcbc077f8bc22a27b110eff135c, NAME => 'testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,271 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 619c7547d9d50bf8bd9bec1a5e9a9982, NAME => 'testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,271 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => f0b9975c4a68468dd3073b40446983e6, NAME => 'testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,271 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 659e0262708e2e98371eaa6dd27372d2, NAME => 'testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,271 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7a942cbce2c213cc475cee5c2f1052be, NAME => 'testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,272 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 08b8c2eefb84f4c836e45fb106402386, NAME => 'testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,295 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,295 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33e1513472144322b25d9b7be304a403 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,299 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,299 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8244917789014a66b0d3b1bd814b7071 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,314 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b789a64351974f498d644b1513a18b1e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,314 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd97a9dbfe8f428aba0e58689dd2d311 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing ab86bdcbc077f8bc22a27b110eff135c, disabling compactions & flushes 2023-02-12 03:03:29,329 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. after waiting 0 ms 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:29,329 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for ab86bdcbc077f8bc22a27b110eff135c: Waiting for close lock at 1676171009328Disabling compacts and flushes for region at 1676171009328Disabling writes for close at 1676171009329 (+1 ms)Writing region close event to WAL at 1676171009329Closed at 1676171009329 2023-02-12 03:03:29,329 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a599c2b0174841591718759ffc2587f6, disabling compactions & flushes 2023-02-12 03:03:29,331 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:29,331 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e970f37f3bea46f73188a99d5dfdae6d, NAME => 'testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. after waiting 0 ms 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:29,331 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,331 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8b2d65c344984a4e930d10b0ec821393 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,331 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 203ca1fadb6648e186f3b4c630e01df9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,331 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a599c2b0174841591718759ffc2587f6: Waiting for close lock at 1676171009329Disabling compacts and flushes for region at 1676171009329Disabling writes for close at 1676171009331 (+2 ms)Writing region close event to WAL at 1676171009331Closed at 1676171009331 2023-02-12 03:03:29,332 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing f0b9975c4a68468dd3073b40446983e6, disabling compactions & flushes 2023-02-12 03:03:29,333 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 803b24e2afa27cd17b40934b13589e6c, NAME => 'testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,333 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:29,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:29,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. after waiting 0 ms 2023-02-12 03:03:29,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:29,333 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:29,333 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for f0b9975c4a68468dd3073b40446983e6: Waiting for close lock at 1676171009332Disabling compacts and flushes for region at 1676171009332Disabling writes for close at 1676171009333 (+1 ms)Writing region close event to WAL at 1676171009333Closed at 1676171009333 2023-02-12 03:03:29,344 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 63086ce1155c494b93c89ea33e61dc3a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,345 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,345 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a50e074798a54e8f810bdf94537a06c9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,351 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08e4be0a434748e7a21f358cb3c6fdcf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,358 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,358 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 875ed23e10954226bdd0bfe9f1e83f2d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,365 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 7a942cbce2c213cc475cee5c2f1052be, disabling compactions & flushes 2023-02-12 03:03:29,365 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 619c7547d9d50bf8bd9bec1a5e9a9982, disabling compactions & flushes 2023-02-12 03:03:29,365 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:29,366 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. after waiting 0 ms 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. after waiting 0 ms 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:29,366 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:29,366 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 7a942cbce2c213cc475cee5c2f1052be: Waiting for close lock at 1676171009365Disabling compacts and flushes for region at 1676171009365Disabling writes for close at 1676171009366 (+1 ms)Writing region close event to WAL at 1676171009366Closed at 1676171009366 2023-02-12 03:03:29,366 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Waiting for close lock at 1676171009365Disabling compacts and flushes for region at 1676171009365Disabling writes for close at 1676171009366 (+1 ms)Writing region close event to WAL at 1676171009366Closed at 1676171009366 2023-02-12 03:03:29,374 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d9352375cac543e88bd6a360bd16e823 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,374 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f537de7000ff4a4586fc0ec3657221a7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,378 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,378 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5a3f2a1e4e7447139bc6e0ba21ce7012 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,379 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 659e0262708e2e98371eaa6dd27372d2, disabling compactions & flushes 2023-02-12 03:03:29,379 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:29,379 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:29,379 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. after waiting 0 ms 2023-02-12 03:03:29,379 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:29,379 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:29,379 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 659e0262708e2e98371eaa6dd27372d2: Waiting for close lock at 1676171009379Disabling compacts and flushes for region at 1676171009379Disabling writes for close at 1676171009379Writing region close event to WAL at 1676171009379Closed at 1676171009379 2023-02-12 03:03:29,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing eef95a0c5bc7339cb77860d544dc9e5a, disabling compactions & flushes 2023-02-12 03:03:29,380 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:29,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:29,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. after waiting 0 ms 2023-02-12 03:03:29,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:29,380 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:29,380 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for eef95a0c5bc7339cb77860d544dc9e5a: Waiting for close lock at 1676171009380Disabling compacts and flushes for region at 1676171009380Disabling writes for close at 1676171009380Writing region close event to WAL at 1676171009380Closed at 1676171009380 2023-02-12 03:03:29,381 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 45a00973d663476b96271974ee4c9d7f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,384 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 803b24e2afa27cd17b40934b13589e6c, disabling compactions & flushes 2023-02-12 03:03:29,384 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:29,384 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:29,384 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. after waiting 0 ms 2023-02-12 03:03:29,384 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:29,384 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:29,384 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 803b24e2afa27cd17b40934b13589e6c: Waiting for close lock at 1676171009384Disabling compacts and flushes for region at 1676171009384Disabling writes for close at 1676171009384Writing region close event to WAL at 1676171009384Closed at 1676171009384 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 08b8c2eefb84f4c836e45fb106402386, disabling compactions & flushes 2023-02-12 03:03:29,735 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. after waiting 0 ms 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:29,735 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:29,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 08b8c2eefb84f4c836e45fb106402386: Waiting for close lock at 1676171009735Disabling compacts and flushes for region at 1676171009735Disabling writes for close at 1676171009735Writing region close event to WAL at 1676171009735Closed at 1676171009735 2023-02-12 03:03:29,769 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:29,769 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b616e7d90fb4494f9a514c6b864432f6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,772 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8b5c623a89b64e039294c0b939641279 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 03:03:29,774 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e970f37f3bea46f73188a99d5dfdae6d, disabling compactions & flushes 2023-02-12 03:03:29,774 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:29,774 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:29,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. after waiting 0 ms 2023-02-12 03:03:29,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:29,775 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:29,775 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e970f37f3bea46f73188a99d5dfdae6d: Waiting for close lock at 1676171009774Disabling compacts and flushes for region at 1676171009774Disabling writes for close at 1676171009775 (+1 ms)Writing region close event to WAL at 1676171009775Closed at 1676171009775 2023-02-12 03:03:29,775 INFO [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676171005861 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:29,775 DEBUG [Listener at localhost/42187] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,775 DEBUG [Listener at localhost/42187] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407 2023-02-12 03:03:29,776 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-data/ 2023-02-12 03:03:29,777 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----default/ 2023-02-12 03:03:29,777 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 03:03:29,778 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------08b8c2eefb84f4c836e45fb106402386/ 2023-02-12 03:03:29,778 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,778 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------619c7547d9d50bf8bd9bec1a5e9a9982/ 2023-02-12 03:03:29,779 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,779 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,779 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=619c7547d9d50bf8bd9bec1a5e9a9982-203ca1fadb6648e186f3b4c630e01df9 2023-02-12 03:03:29,779 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,780 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=619c7547d9d50bf8bd9bec1a5e9a9982-08e4be0a434748e7a21f358cb3c6fdcf 2023-02-12 03:03:29,780 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------659e0262708e2e98371eaa6dd27372d2/ 2023-02-12 03:03:29,780 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,780 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,781 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=659e0262708e2e98371eaa6dd27372d2-a50e074798a54e8f810bdf94537a06c9 2023-02-12 03:03:29,781 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,781 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=659e0262708e2e98371eaa6dd27372d2-d9352375cac543e88bd6a360bd16e823 2023-02-12 03:03:29,781 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------7a942cbce2c213cc475cee5c2f1052be/ 2023-02-12 03:03:29,782 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,782 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,782 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=7a942cbce2c213cc475cee5c2f1052be-8b2d65c344984a4e930d10b0ec821393 2023-02-12 03:03:29,782 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,783 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=7a942cbce2c213cc475cee5c2f1052be-63086ce1155c494b93c89ea33e61dc3a 2023-02-12 03:03:29,783 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------803b24e2afa27cd17b40934b13589e6c/ 2023-02-12 03:03:29,783 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,784 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,784 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=803b24e2afa27cd17b40934b13589e6c-5a3f2a1e4e7447139bc6e0ba21ce7012 2023-02-12 03:03:29,784 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,784 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=803b24e2afa27cd17b40934b13589e6c-45a00973d663476b96271974ee4c9d7f 2023-02-12 03:03:29,784 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------a599c2b0174841591718759ffc2587f6/ 2023-02-12 03:03:29,785 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,785 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,786 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=a599c2b0174841591718759ffc2587f6-33e1513472144322b25d9b7be304a403 2023-02-12 03:03:29,786 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,786 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=a599c2b0174841591718759ffc2587f6-dd97a9dbfe8f428aba0e58689dd2d311 2023-02-12 03:03:29,786 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------ab86bdcbc077f8bc22a27b110eff135c/ 2023-02-12 03:03:29,787 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,787 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,788 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=ab86bdcbc077f8bc22a27b110eff135c-8244917789014a66b0d3b1bd814b7071 2023-02-12 03:03:29,788 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,788 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=ab86bdcbc077f8bc22a27b110eff135c-b789a64351974f498d644b1513a18b1e 2023-02-12 03:03:29,788 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------e970f37f3bea46f73188a99d5dfdae6d/ 2023-02-12 03:03:29,789 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,789 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,790 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=e970f37f3bea46f73188a99d5dfdae6d-b616e7d90fb4494f9a514c6b864432f6 2023-02-12 03:03:29,790 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,790 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=e970f37f3bea46f73188a99d5dfdae6d-8b5c623a89b64e039294c0b939641279 2023-02-12 03:03:29,790 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------eef95a0c5bc7339cb77860d544dc9e5a/ 2023-02-12 03:03:29,791 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,791 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:29,791 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=eef95a0c5bc7339cb77860d544dc9e5a-875ed23e10954226bdd0bfe9f1e83f2d 2023-02-12 03:03:29,792 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:29,792 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |----------------testWithMapReduce=eef95a0c5bc7339cb77860d544dc9e5a-f537de7000ff4a4586fc0ec3657221a7 2023-02-12 03:03:29,792 DEBUG [Listener at localhost/42187] util.CommonFSUtils(699): |----------f0b9975c4a68468dd3073b40446983e6/ 2023-02-12 03:03:29,793 DEBUG [Listener at localhost/42187] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:29,801 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,802 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,802 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,803 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,803 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,803 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,804 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,876 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:29,877 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 03:03:29,879 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop-683712101586810116.jar 2023-02-12 03:03:29,879 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,880 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,880 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,881 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,881 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,881 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,882 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 03:03:29,883 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 03:03:29,883 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 03:03:29,883 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 03:03:29,884 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 03:03:29,884 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 03:03:29,885 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 03:03:29,885 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 03:03:29,886 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 03:03:29,886 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 03:03:29,892 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:29,892 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:29,892 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:29,893 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:29,893 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:03:29,966 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop-1856800399506619855.jar 2023-02-12 03:03:29,967 DEBUG [Listener at localhost/42187] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:03:30,018 WARN [Listener at localhost/42187] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 03:03:30,083 INFO [Listener at localhost/42187] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 03:03:30,478 WARN [Listener at localhost/42187] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/mapreduce.cluster.local.dir/1676171010375/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 03:03:30,478 WARN [Listener at localhost/42187] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/mapreduce.cluster.local.dir/1676171010375/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 03:03:30,619 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:30,619 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:30,621 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:30,623 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:30,625 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f1 2023-02-12 03:03:30,626 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b8c2eefb84f4c836e45fb106402386 columnFamilyName f1 2023-02-12 03:03:30,626 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(310): Store=08b8c2eefb84f4c836e45fb106402386/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,627 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:30,629 DEBUG [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f2 2023-02-12 03:03:30,629 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b8c2eefb84f4c836e45fb106402386 columnFamilyName f2 2023-02-12 03:03:30,630 INFO [StoreOpener-08b8c2eefb84f4c836e45fb106402386-1] regionserver.HStore(310): Store=08b8c2eefb84f4c836e45fb106402386/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,630 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:30,630 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08b8c2eefb84f4c836e45fb106402386; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62804388, jitterRate=-0.06414169073104858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:30,631 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08b8c2eefb84f4c836e45fb106402386: Writing region info on filesystem at 1676171010621Initializing all the Stores at 1676171010623 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010623Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010623Region opened successfully at 1676171010631 (+8 ms) 2023-02-12 03:03:30,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08b8c2eefb84f4c836e45fb106402386, disabling compactions & flushes 2023-02-12 03:03:30,669 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:30,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:30,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. after waiting 0 ms 2023-02-12 03:03:30,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:30,670 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:30,670 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08b8c2eefb84f4c836e45fb106402386: Waiting for close lock at 1676171010669Disabling compacts and flushes for region at 1676171010669Disabling writes for close at 1676171010670 (+1 ms)Writing region close event to WAL at 1676171010670Closed at 1676171010670 2023-02-12 03:03:30,683 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:30,683 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:30,684 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:30,686 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:30,687 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1 2023-02-12 03:03:30,688 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619c7547d9d50bf8bd9bec1a5e9a9982 columnFamilyName f1 2023-02-12 03:03:30,696 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/testWithMapReduce=619c7547d9d50bf8bd9bec1a5e9a9982-203ca1fadb6648e186f3b4c630e01df9 2023-02-12 03:03:30,697 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(310): Store=619c7547d9d50bf8bd9bec1a5e9a9982/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,697 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:30,698 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2 2023-02-12 03:03:30,698 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 619c7547d9d50bf8bd9bec1a5e9a9982 columnFamilyName f2 2023-02-12 03:03:30,704 DEBUG [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/testWithMapReduce=619c7547d9d50bf8bd9bec1a5e9a9982-08e4be0a434748e7a21f358cb3c6fdcf 2023-02-12 03:03:30,704 INFO [StoreOpener-619c7547d9d50bf8bd9bec1a5e9a9982-1] regionserver.HStore(310): Store=619c7547d9d50bf8bd9bec1a5e9a9982/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:30,705 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 619c7547d9d50bf8bd9bec1a5e9a9982; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72883773, jitterRate=0.08605284988880157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:30,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Writing region info on filesystem at 1676171010684Initializing all the Stores at 1676171010685 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010685Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010685Region opened successfully at 1676171010705 (+20 ms) 2023-02-12 03:03:30,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 619c7547d9d50bf8bd9bec1a5e9a9982, disabling compactions & flushes 2023-02-12 03:03:30,836 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:30,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:30,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. after waiting 0 ms 2023-02-12 03:03:30,837 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:30,842 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:30,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Waiting for close lock at 1676171010836Disabling compacts and flushes for region at 1676171010836Disabling writes for close at 1676171010837 (+1 ms)Writing region close event to WAL at 1676171010842 (+5 ms)Closed at 1676171010842 2023-02-12 03:03:30,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:30,847 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:30,849 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:30,852 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:30,853 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1 2023-02-12 03:03:30,853 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 659e0262708e2e98371eaa6dd27372d2 columnFamilyName f1 2023-02-12 03:03:30,860 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/testWithMapReduce=659e0262708e2e98371eaa6dd27372d2-a50e074798a54e8f810bdf94537a06c9 2023-02-12 03:03:30,860 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(310): Store=659e0262708e2e98371eaa6dd27372d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,860 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:30,861 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2 2023-02-12 03:03:30,862 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 659e0262708e2e98371eaa6dd27372d2 columnFamilyName f2 2023-02-12 03:03:30,868 DEBUG [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/testWithMapReduce=659e0262708e2e98371eaa6dd27372d2-d9352375cac543e88bd6a360bd16e823 2023-02-12 03:03:30,869 INFO [StoreOpener-659e0262708e2e98371eaa6dd27372d2-1] regionserver.HStore(310): Store=659e0262708e2e98371eaa6dd27372d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:30,869 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 659e0262708e2e98371eaa6dd27372d2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60103672, jitterRate=-0.10438549518585205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:30,869 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 659e0262708e2e98371eaa6dd27372d2: Writing region info on filesystem at 1676171010849Initializing all the Stores at 1676171010851 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010851Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010851Region opened successfully at 1676171010869 (+18 ms) 2023-02-12 03:03:30,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 659e0262708e2e98371eaa6dd27372d2, disabling compactions & flushes 2023-02-12 03:03:30,915 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:30,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:30,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. after waiting 0 ms 2023-02-12 03:03:30,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:30,919 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:30,919 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 659e0262708e2e98371eaa6dd27372d2: Waiting for close lock at 1676171010915Disabling compacts and flushes for region at 1676171010915Disabling writes for close at 1676171010915Writing region close event to WAL at 1676171010919 (+4 ms)Closed at 1676171010919 2023-02-12 03:03:30,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:30,924 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:30,926 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:30,928 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:30,929 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1 2023-02-12 03:03:30,930 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803b24e2afa27cd17b40934b13589e6c columnFamilyName f1 2023-02-12 03:03:30,946 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/testWithMapReduce=803b24e2afa27cd17b40934b13589e6c-5a3f2a1e4e7447139bc6e0ba21ce7012 2023-02-12 03:03:30,946 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(310): Store=803b24e2afa27cd17b40934b13589e6c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,946 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:30,951 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2 2023-02-12 03:03:30,952 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 803b24e2afa27cd17b40934b13589e6c columnFamilyName f2 2023-02-12 03:03:30,959 DEBUG [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/testWithMapReduce=803b24e2afa27cd17b40934b13589e6c-45a00973d663476b96271974ee4c9d7f 2023-02-12 03:03:30,960 INFO [StoreOpener-803b24e2afa27cd17b40934b13589e6c-1] regionserver.HStore(310): Store=803b24e2afa27cd17b40934b13589e6c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:30,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:30,960 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 803b24e2afa27cd17b40934b13589e6c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74410826, jitterRate=0.10880771279335022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:30,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 803b24e2afa27cd17b40934b13589e6c: Writing region info on filesystem at 1676171010926Initializing all the Stores at 1676171010927 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010928 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171010928Region opened successfully at 1676171010960 (+32 ms) 2023-02-12 03:03:31,053 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 803b24e2afa27cd17b40934b13589e6c, disabling compactions & flushes 2023-02-12 03:03:31,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:31,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:31,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. after waiting 0 ms 2023-02-12 03:03:31,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:31,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:31,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 803b24e2afa27cd17b40934b13589e6c: Waiting for close lock at 1676171011053Disabling compacts and flushes for region at 1676171011053Disabling writes for close at 1676171011054 (+1 ms)Writing region close event to WAL at 1676171011057 (+3 ms)Closed at 1676171011057 2023-02-12 03:03:31,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,062 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,064 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,066 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:31,067 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1 2023-02-12 03:03:31,068 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a599c2b0174841591718759ffc2587f6 columnFamilyName f1 2023-02-12 03:03:31,075 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/testWithMapReduce=a599c2b0174841591718759ffc2587f6-33e1513472144322b25d9b7be304a403 2023-02-12 03:03:31,076 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(310): Store=a599c2b0174841591718759ffc2587f6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,076 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:31,077 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2 2023-02-12 03:03:31,078 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a599c2b0174841591718759ffc2587f6 columnFamilyName f2 2023-02-12 03:03:31,084 DEBUG [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/testWithMapReduce=a599c2b0174841591718759ffc2587f6-dd97a9dbfe8f428aba0e58689dd2d311 2023-02-12 03:03:31,084 INFO [StoreOpener-a599c2b0174841591718759ffc2587f6-1] regionserver.HStore(310): Store=a599c2b0174841591718759ffc2587f6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,084 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a599c2b0174841591718759ffc2587f6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61553829, jitterRate=-0.08277647197246552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a599c2b0174841591718759ffc2587f6: Writing region info on filesystem at 1676171011064Initializing all the Stores at 1676171011065 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011066 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011066Region opened successfully at 1676171011084 (+18 ms) 2023-02-12 03:03:31,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a599c2b0174841591718759ffc2587f6, disabling compactions & flushes 2023-02-12 03:03:31,123 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:31,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:31,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. after waiting 0 ms 2023-02-12 03:03:31,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:31,126 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:31,126 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a599c2b0174841591718759ffc2587f6: Waiting for close lock at 1676171011122Disabling compacts and flushes for region at 1676171011122Disabling writes for close at 1676171011123 (+1 ms)Writing region close event to WAL at 1676171011126 (+3 ms)Closed at 1676171011126 2023-02-12 03:03:31,133 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,133 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,146 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,149 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:31,151 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1 2023-02-12 03:03:31,151 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab86bdcbc077f8bc22a27b110eff135c columnFamilyName f1 2023-02-12 03:03:31,160 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/testWithMapReduce=ab86bdcbc077f8bc22a27b110eff135c-8244917789014a66b0d3b1bd814b7071 2023-02-12 03:03:31,160 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(310): Store=ab86bdcbc077f8bc22a27b110eff135c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,160 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:31,162 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2 2023-02-12 03:03:31,162 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab86bdcbc077f8bc22a27b110eff135c columnFamilyName f2 2023-02-12 03:03:31,170 DEBUG [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/testWithMapReduce=ab86bdcbc077f8bc22a27b110eff135c-b789a64351974f498d644b1513a18b1e 2023-02-12 03:03:31,171 INFO [StoreOpener-ab86bdcbc077f8bc22a27b110eff135c-1] regionserver.HStore(310): Store=ab86bdcbc077f8bc22a27b110eff135c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,171 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ab86bdcbc077f8bc22a27b110eff135c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61527649, jitterRate=-0.08316658437252045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ab86bdcbc077f8bc22a27b110eff135c: Writing region info on filesystem at 1676171011146Initializing all the Stores at 1676171011148 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011148Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011148Region opened successfully at 1676171011171 (+23 ms) 2023-02-12 03:03:31,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ab86bdcbc077f8bc22a27b110eff135c, disabling compactions & flushes 2023-02-12 03:03:31,218 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:31,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:31,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. after waiting 0 ms 2023-02-12 03:03:31,218 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:31,223 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:31,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ab86bdcbc077f8bc22a27b110eff135c: Waiting for close lock at 1676171011218Disabling compacts and flushes for region at 1676171011218Disabling writes for close at 1676171011218Writing region close event to WAL at 1676171011223 (+5 ms)Closed at 1676171011223 2023-02-12 03:03:31,244 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,244 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,248 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,251 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:31,253 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f1 2023-02-12 03:03:31,254 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0b9975c4a68468dd3073b40446983e6 columnFamilyName f1 2023-02-12 03:03:31,255 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(310): Store=f0b9975c4a68468dd3073b40446983e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,255 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:31,257 DEBUG [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f2 2023-02-12 03:03:31,258 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0b9975c4a68468dd3073b40446983e6 columnFamilyName f2 2023-02-12 03:03:31,259 INFO [StoreOpener-f0b9975c4a68468dd3073b40446983e6-1] regionserver.HStore(310): Store=f0b9975c4a68468dd3073b40446983e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,259 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f0b9975c4a68468dd3073b40446983e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65015720, jitterRate=-0.03119027614593506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f0b9975c4a68468dd3073b40446983e6: Writing region info on filesystem at 1676171011248Initializing all the Stores at 1676171011249 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011249Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011250 (+1 ms)Region opened successfully at 1676171011259 (+9 ms) 2023-02-12 03:03:31,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f0b9975c4a68468dd3073b40446983e6, disabling compactions & flushes 2023-02-12 03:03:31,283 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:31,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:31,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. after waiting 0 ms 2023-02-12 03:03:31,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:31,284 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:31,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f0b9975c4a68468dd3073b40446983e6: Waiting for close lock at 1676171011283Disabling compacts and flushes for region at 1676171011283Disabling writes for close at 1676171011283Writing region close event to WAL at 1676171011284 (+1 ms)Closed at 1676171011284 2023-02-12 03:03:31,291 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,291 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,292 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,295 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:31,296 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1 2023-02-12 03:03:31,297 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a942cbce2c213cc475cee5c2f1052be columnFamilyName f1 2023-02-12 03:03:31,304 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/testWithMapReduce=7a942cbce2c213cc475cee5c2f1052be-8b2d65c344984a4e930d10b0ec821393 2023-02-12 03:03:31,304 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(310): Store=7a942cbce2c213cc475cee5c2f1052be/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,304 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:31,305 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2 2023-02-12 03:03:31,306 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a942cbce2c213cc475cee5c2f1052be columnFamilyName f2 2023-02-12 03:03:31,314 DEBUG [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/testWithMapReduce=7a942cbce2c213cc475cee5c2f1052be-63086ce1155c494b93c89ea33e61dc3a 2023-02-12 03:03:31,314 INFO [StoreOpener-7a942cbce2c213cc475cee5c2f1052be-1] regionserver.HStore(310): Store=7a942cbce2c213cc475cee5c2f1052be/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,314 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7a942cbce2c213cc475cee5c2f1052be; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66235096, jitterRate=-0.013020157814025879}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7a942cbce2c213cc475cee5c2f1052be: Writing region info on filesystem at 1676171011292Initializing all the Stores at 1676171011294 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011294Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011294Region opened successfully at 1676171011314 (+20 ms) 2023-02-12 03:03:31,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7a942cbce2c213cc475cee5c2f1052be, disabling compactions & flushes 2023-02-12 03:03:31,356 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:31,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:31,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. after waiting 0 ms 2023-02-12 03:03:31,356 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:31,378 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:31,378 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7a942cbce2c213cc475cee5c2f1052be: Waiting for close lock at 1676171011356Disabling compacts and flushes for region at 1676171011356Disabling writes for close at 1676171011356Writing region close event to WAL at 1676171011378 (+22 ms)Closed at 1676171011378 2023-02-12 03:03:31,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,384 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,387 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,390 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:31,392 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1 2023-02-12 03:03:31,392 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eef95a0c5bc7339cb77860d544dc9e5a columnFamilyName f1 2023-02-12 03:03:31,401 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/testWithMapReduce=eef95a0c5bc7339cb77860d544dc9e5a-875ed23e10954226bdd0bfe9f1e83f2d 2023-02-12 03:03:31,401 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(310): Store=eef95a0c5bc7339cb77860d544dc9e5a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,401 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:31,403 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2 2023-02-12 03:03:31,404 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eef95a0c5bc7339cb77860d544dc9e5a columnFamilyName f2 2023-02-12 03:03:31,410 DEBUG [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/testWithMapReduce=eef95a0c5bc7339cb77860d544dc9e5a-f537de7000ff4a4586fc0ec3657221a7 2023-02-12 03:03:31,411 INFO [StoreOpener-eef95a0c5bc7339cb77860d544dc9e5a-1] regionserver.HStore(310): Store=eef95a0c5bc7339cb77860d544dc9e5a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,411 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened eef95a0c5bc7339cb77860d544dc9e5a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60018767, jitterRate=-0.10565067827701569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,411 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for eef95a0c5bc7339cb77860d544dc9e5a: Writing region info on filesystem at 1676171011387Initializing all the Stores at 1676171011389 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011389Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011389Region opened successfully at 1676171011411 (+22 ms) 2023-02-12 03:03:31,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing eef95a0c5bc7339cb77860d544dc9e5a, disabling compactions & flushes 2023-02-12 03:03:31,460 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:31,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:31,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. after waiting 0 ms 2023-02-12 03:03:31,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:31,467 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:31,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for eef95a0c5bc7339cb77860d544dc9e5a: Waiting for close lock at 1676171011460Disabling compacts and flushes for region at 1676171011460Disabling writes for close at 1676171011460Writing region close event to WAL at 1676171011467 (+7 ms)Closed at 1676171011467 2023-02-12 03:03:31,472 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:31,472 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:31,478 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:31,481 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:31,482 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1 2023-02-12 03:03:31,483 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e970f37f3bea46f73188a99d5dfdae6d columnFamilyName f1 2023-02-12 03:03:31,490 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/testWithMapReduce=e970f37f3bea46f73188a99d5dfdae6d-b616e7d90fb4494f9a514c6b864432f6 2023-02-12 03:03:31,490 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(310): Store=e970f37f3bea46f73188a99d5dfdae6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,491 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:31,492 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2 2023-02-12 03:03:31,492 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e970f37f3bea46f73188a99d5dfdae6d columnFamilyName f2 2023-02-12 03:03:31,500 DEBUG [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(539): loaded hdfs://localhost:35265/user/jenkins/test-data/e2407f41-3926-74b9-3871-7799ffbfebbf/testWithMapReduceMultiRegion/c9039327-ac96-4f63-8c17-409d9f414407/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/testWithMapReduce=e970f37f3bea46f73188a99d5dfdae6d-8b5c623a89b64e039294c0b939641279 2023-02-12 03:03:31,500 INFO [StoreOpener-e970f37f3bea46f73188a99d5dfdae6d-1] regionserver.HStore(310): Store=e970f37f3bea46f73188a99d5dfdae6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:31,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:31,501 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e970f37f3bea46f73188a99d5dfdae6d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72628018, jitterRate=0.08224180340766907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:31,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e970f37f3bea46f73188a99d5dfdae6d: Writing region info on filesystem at 1676171011478Initializing all the Stores at 1676171011480 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011480Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171011480Region opened successfully at 1676171011501 (+21 ms) 2023-02-12 03:03:31,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e970f37f3bea46f73188a99d5dfdae6d, disabling compactions & flushes 2023-02-12 03:03:31,535 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:31,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:31,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. after waiting 0 ms 2023-02-12 03:03:31,535 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:31,538 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:31,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e970f37f3bea46f73188a99d5dfdae6d: Waiting for close lock at 1676171011535Disabling compacts and flushes for region at 1676171011535Disabling writes for close at 1676171011535Writing region close event to WAL at 1676171011538 (+3 ms)Closed at 1676171011538 2023-02-12 03:03:32,556 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMapReduceMultiRegion" 2023-02-12 03:03:32,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-12 03:03:32,564 INFO [Listener at localhost/42187] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 03:03:32,564 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-12 03:03:32,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 03:03:32,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171012576"}]},"ts":"1676171012576"} 2023-02-12 03:03:32,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:32,579 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 03:03:32,582 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 03:03:32,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, UNASSIGN}] 2023-02-12 03:03:32,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, UNASSIGN 2023-02-12 03:03:32,589 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, UNASSIGN 2023-02-12 03:03:32,590 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, UNASSIGN 2023-02-12 03:03:32,590 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, UNASSIGN 2023-02-12 03:03:32,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=619c7547d9d50bf8bd9bec1a5e9a9982, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:32,591 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, UNASSIGN 2023-02-12 03:03:32,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012591"}]},"ts":"1676171012591"} 2023-02-12 03:03:32,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e970f37f3bea46f73188a99d5dfdae6d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:32,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=659e0262708e2e98371eaa6dd27372d2, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:32,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012591"}]},"ts":"1676171012591"} 2023-02-12 03:03:32,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012591"}]},"ts":"1676171012591"} 2023-02-12 03:03:32,592 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a599c2b0174841591718759ffc2587f6, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:32,592 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012592"}]},"ts":"1676171012592"} 2023-02-12 03:03:32,592 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f0b9975c4a68468dd3073b40446983e6, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:32,592 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171012592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012592"}]},"ts":"1676171012592"} 2023-02-12 03:03:32,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 619c7547d9d50bf8bd9bec1a5e9a9982, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:32,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure e970f37f3bea46f73188a99d5dfdae6d, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:32,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 659e0262708e2e98371eaa6dd27372d2, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:32,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure f0b9975c4a68468dd3073b40446983e6, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:32,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure a599c2b0174841591718759ffc2587f6, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:32,605 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, UNASSIGN 2023-02-12 03:03:32,606 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, UNASSIGN 2023-02-12 03:03:32,606 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, UNASSIGN 2023-02-12 03:03:32,606 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, UNASSIGN 2023-02-12 03:03:32,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ab86bdcbc077f8bc22a27b110eff135c, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:32,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012606"}]},"ts":"1676171012606"} 2023-02-12 03:03:32,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7a942cbce2c213cc475cee5c2f1052be, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:32,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=803b24e2afa27cd17b40934b13589e6c, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:32,607 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=eef95a0c5bc7339cb77860d544dc9e5a, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:32,607 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012607"}]},"ts":"1676171012607"} 2023-02-12 03:03:32,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012607"}]},"ts":"1676171012607"} 2023-02-12 03:03:32,608 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, UNASSIGN 2023-02-12 03:03:32,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012607"}]},"ts":"1676171012607"} 2023-02-12 03:03:32,609 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=08b8c2eefb84f4c836e45fb106402386, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:32,609 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171012609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171012609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171012609"}]},"ts":"1676171012609"} 2023-02-12 03:03:32,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure ab86bdcbc077f8bc22a27b110eff135c, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:32,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 7a942cbce2c213cc475cee5c2f1052be, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:32,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure 803b24e2afa27cd17b40934b13589e6c, server=jenkins-hbase6.apache.org,34483,1676171001018}] 2023-02-12 03:03:32,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=40, state=RUNNABLE; CloseRegionProcedure eef95a0c5bc7339cb77860d544dc9e5a, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:32,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 08b8c2eefb84f4c836e45fb106402386, server=jenkins-hbase6.apache.org,39031,1676171000966}] 2023-02-12 03:03:32,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:32,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:32,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 659e0262708e2e98371eaa6dd27372d2, disabling compactions & flushes 2023-02-12 03:03:32,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:32,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:32,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. after waiting 0 ms 2023-02-12 03:03:32,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:32,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:32,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing e970f37f3bea46f73188a99d5dfdae6d, disabling compactions & flushes 2023-02-12 03:03:32,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:32,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:32,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. after waiting 0 ms 2023-02-12 03:03:32,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:32,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2. 2023-02-12 03:03:32,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d. 2023-02-12 03:03:32,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 659e0262708e2e98371eaa6dd27372d2: Waiting for close lock at 1676171012756Running coprocessor pre-close hooks at 1676171012756Disabling compacts and flushes for region at 1676171012756Disabling writes for close at 1676171012756Writing region close event to WAL at 1676171012779 (+23 ms)Running coprocessor post-close hooks at 1676171012786 (+7 ms)Closed at 1676171012786 2023-02-12 03:03:32,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for e970f37f3bea46f73188a99d5dfdae6d: Waiting for close lock at 1676171012759Running coprocessor pre-close hooks at 1676171012759Disabling compacts and flushes for region at 1676171012759Disabling writes for close at 1676171012759Writing region close event to WAL at 1676171012780 (+21 ms)Running coprocessor post-close hooks at 1676171012785 (+5 ms)Closed at 1676171012786 (+1 ms) 2023-02-12 03:03:32,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:32,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:32,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 619c7547d9d50bf8bd9bec1a5e9a9982, disabling compactions & flushes 2023-02-12 03:03:32,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:32,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:32,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. after waiting 0 ms 2023-02-12 03:03:32,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:32,789 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=659e0262708e2e98371eaa6dd27372d2, regionState=CLOSED 2023-02-12 03:03:32,789 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012789"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012789"}]},"ts":"1676171012789"} 2023-02-12 03:03:32,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:32,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:32,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 08b8c2eefb84f4c836e45fb106402386, disabling compactions & flushes 2023-02-12 03:03:32,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:32,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:32,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. after waiting 0 ms 2023-02-12 03:03:32,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:32,792 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e970f37f3bea46f73188a99d5dfdae6d, regionState=CLOSED 2023-02-12 03:03:32,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012792"}]},"ts":"1676171012792"} 2023-02-12 03:03:32,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-12 03:03:32,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 659e0262708e2e98371eaa6dd27372d2, server=jenkins-hbase6.apache.org,34483,1676171001018 in 196 msec 2023-02-12 03:03:32,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-12 03:03:32,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure e970f37f3bea46f73188a99d5dfdae6d, server=jenkins-hbase6.apache.org,39031,1676171000966 in 198 msec 2023-02-12 03:03:32,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=659e0262708e2e98371eaa6dd27372d2, UNASSIGN in 212 msec 2023-02-12 03:03:32,799 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e970f37f3bea46f73188a99d5dfdae6d, UNASSIGN in 213 msec 2023-02-12 03:03:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:32,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386. 2023-02-12 03:03:32,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982. 2023-02-12 03:03:32,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 08b8c2eefb84f4c836e45fb106402386: Waiting for close lock at 1676171012792Running coprocessor pre-close hooks at 1676171012792Disabling compacts and flushes for region at 1676171012792Disabling writes for close at 1676171012792Writing region close event to WAL at 1676171012795 (+3 ms)Running coprocessor post-close hooks at 1676171012805 (+10 ms)Closed at 1676171012806 (+1 ms) 2023-02-12 03:03:32,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 619c7547d9d50bf8bd9bec1a5e9a9982: Waiting for close lock at 1676171012789Running coprocessor pre-close hooks at 1676171012789Disabling compacts and flushes for region at 1676171012789Disabling writes for close at 1676171012789Writing region close event to WAL at 1676171012795 (+6 ms)Running coprocessor post-close hooks at 1676171012805 (+10 ms)Closed at 1676171012806 (+1 ms) 2023-02-12 03:03:32,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:32,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:32,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing a599c2b0174841591718759ffc2587f6, disabling compactions & flushes 2023-02-12 03:03:32,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:32,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. after waiting 1 ms 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:32,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:32,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:32,810 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=08b8c2eefb84f4c836e45fb106402386, regionState=CLOSED 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 803b24e2afa27cd17b40934b13589e6c, disabling compactions & flushes 2023-02-12 03:03:32,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:32,810 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171012810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012810"}]},"ts":"1676171012810"} 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. after waiting 0 ms 2023-02-12 03:03:32,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:32,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=619c7547d9d50bf8bd9bec1a5e9a9982, regionState=CLOSED 2023-02-12 03:03:32,810 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012810"}]},"ts":"1676171012810"} 2023-02-12 03:03:32,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-12 03:03:32,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 08b8c2eefb84f4c836e45fb106402386, server=jenkins-hbase6.apache.org,39031,1676171000966 in 198 msec 2023-02-12 03:03:32,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-12 03:03:32,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 619c7547d9d50bf8bd9bec1a5e9a9982, server=jenkins-hbase6.apache.org,34483,1676171001018 in 218 msec 2023-02-12 03:03:32,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08b8c2eefb84f4c836e45fb106402386, UNASSIGN in 232 msec 2023-02-12 03:03:32,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=619c7547d9d50bf8bd9bec1a5e9a9982, UNASSIGN in 233 msec 2023-02-12 03:03:32,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c. 2023-02-12 03:03:32,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 803b24e2afa27cd17b40934b13589e6c: Waiting for close lock at 1676171012810Running coprocessor pre-close hooks at 1676171012810Disabling compacts and flushes for region at 1676171012810Disabling writes for close at 1676171012810Writing region close event to WAL at 1676171012831 (+21 ms)Running coprocessor post-close hooks at 1676171012840 (+9 ms)Closed at 1676171012840 2023-02-12 03:03:32,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6. 2023-02-12 03:03:32,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for a599c2b0174841591718759ffc2587f6: Waiting for close lock at 1676171012809Running coprocessor pre-close hooks at 1676171012809Disabling compacts and flushes for region at 1676171012809Disabling writes for close at 1676171012810 (+1 ms)Writing region close event to WAL at 1676171012831 (+21 ms)Running coprocessor post-close hooks at 1676171012841 (+10 ms)Closed at 1676171012841 2023-02-12 03:03:32,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:32,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:32,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing f0b9975c4a68468dd3073b40446983e6, disabling compactions & flushes 2023-02-12 03:03:32,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:32,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:32,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. after waiting 0 ms 2023-02-12 03:03:32,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:32,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=803b24e2afa27cd17b40934b13589e6c, regionState=CLOSED 2023-02-12 03:03:32,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012844"}]},"ts":"1676171012844"} 2023-02-12 03:03:32,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:32,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing ab86bdcbc077f8bc22a27b110eff135c, disabling compactions & flushes 2023-02-12 03:03:32,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. after waiting 0 ms 2023-02-12 03:03:32,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:32,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a599c2b0174841591718759ffc2587f6, regionState=CLOSED 2023-02-12 03:03:32,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012846"}]},"ts":"1676171012846"} 2023-02-12 03:03:32,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:32,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-12 03:03:32,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure 803b24e2afa27cd17b40934b13589e6c, server=jenkins-hbase6.apache.org,34483,1676171001018 in 236 msec 2023-02-12 03:03:32,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c. 2023-02-12 03:03:32,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for ab86bdcbc077f8bc22a27b110eff135c: Waiting for close lock at 1676171012846Running coprocessor pre-close hooks at 1676171012846Disabling compacts and flushes for region at 1676171012846Disabling writes for close at 1676171012846Writing region close event to WAL at 1676171012848 (+2 ms)Running coprocessor post-close hooks at 1676171012857 (+9 ms)Closed at 1676171012858 (+1 ms) 2023-02-12 03:03:32,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6. 2023-02-12 03:03:32,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for f0b9975c4a68468dd3073b40446983e6: Waiting for close lock at 1676171012844Running coprocessor pre-close hooks at 1676171012844Disabling compacts and flushes for region at 1676171012844Disabling writes for close at 1676171012844Writing region close event to WAL at 1676171012844Running coprocessor post-close hooks at 1676171012858 (+14 ms)Closed at 1676171012859 (+1 ms) 2023-02-12 03:03:32,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-12 03:03:32,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure a599c2b0174841591718759ffc2587f6, server=jenkins-hbase6.apache.org,39031,1676171000966 in 251 msec 2023-02-12 03:03:32,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=803b24e2afa27cd17b40934b13589e6c, UNASSIGN in 273 msec 2023-02-12 03:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 7a942cbce2c213cc475cee5c2f1052be, disabling compactions & flushes 2023-02-12 03:03:32,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. after waiting 0 ms 2023-02-12 03:03:32,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:32,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a599c2b0174841591718759ffc2587f6, UNASSIGN in 276 msec 2023-02-12 03:03:32,879 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f0b9975c4a68468dd3073b40446983e6, regionState=CLOSED 2023-02-12 03:03:32,879 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171012878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012878"}]},"ts":"1676171012878"} 2023-02-12 03:03:32,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:32,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:32,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing eef95a0c5bc7339cb77860d544dc9e5a, disabling compactions & flushes 2023-02-12 03:03:32,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:32,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:32,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. after waiting 0 ms 2023-02-12 03:03:32,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:32,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ab86bdcbc077f8bc22a27b110eff135c, regionState=CLOSED 2023-02-12 03:03:32,881 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012880"}]},"ts":"1676171012880"} 2023-02-12 03:03:32,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:32,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-12 03:03:32,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure f0b9975c4a68468dd3073b40446983e6, server=jenkins-hbase6.apache.org,34483,1676171001018 in 284 msec 2023-02-12 03:03:32,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 03:03:32,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure ab86bdcbc077f8bc22a27b110eff135c, server=jenkins-hbase6.apache.org,39031,1676171000966 in 274 msec 2023-02-12 03:03:32,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f0b9975c4a68468dd3073b40446983e6, UNASSIGN in 299 msec 2023-02-12 03:03:32,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ab86bdcbc077f8bc22a27b110eff135c, UNASSIGN in 300 msec 2023-02-12 03:03:32,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be. 2023-02-12 03:03:32,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 7a942cbce2c213cc475cee5c2f1052be: Waiting for close lock at 1676171012862Running coprocessor pre-close hooks at 1676171012862Disabling compacts and flushes for region at 1676171012862Disabling writes for close at 1676171012862Writing region close event to WAL at 1676171012866 (+4 ms)Running coprocessor post-close hooks at 1676171012888 (+22 ms)Closed at 1676171012889 (+1 ms) 2023-02-12 03:03:32,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:32,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7a942cbce2c213cc475cee5c2f1052be, regionState=CLOSED 2023-02-12 03:03:32,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012892"}]},"ts":"1676171012892"} 2023-02-12 03:03:32,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:32,896 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a. 2023-02-12 03:03:32,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for eef95a0c5bc7339cb77860d544dc9e5a: Waiting for close lock at 1676171012879Running coprocessor pre-close hooks at 1676171012879Disabling compacts and flushes for region at 1676171012879Disabling writes for close at 1676171012879Writing region close event to WAL at 1676171012890 (+11 ms)Running coprocessor post-close hooks at 1676171012895 (+5 ms)Closed at 1676171012896 (+1 ms) 2023-02-12 03:03:32,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:32,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 03:03:32,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 7a942cbce2c213cc475cee5c2f1052be, server=jenkins-hbase6.apache.org,34483,1676171001018 in 284 msec 2023-02-12 03:03:32,899 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=eef95a0c5bc7339cb77860d544dc9e5a, regionState=CLOSED 2023-02-12 03:03:32,900 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171012899"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171012899"}]},"ts":"1676171012899"} 2023-02-12 03:03:32,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7a942cbce2c213cc475cee5c2f1052be, UNASSIGN in 315 msec 2023-02-12 03:03:32,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=40 2023-02-12 03:03:32,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=40, state=SUCCESS; CloseRegionProcedure eef95a0c5bc7339cb77860d544dc9e5a, server=jenkins-hbase6.apache.org,39031,1676171000966 in 289 msec 2023-02-12 03:03:32,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-12 03:03:32,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eef95a0c5bc7339cb77860d544dc9e5a, UNASSIGN in 320 msec 2023-02-12 03:03:32,907 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171012907"}]},"ts":"1676171012907"} 2023-02-12 03:03:32,909 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 03:03:32,911 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 03:03:32,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 347 msec 2023-02-12 03:03:33,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:33,185 INFO [Listener at localhost/42187] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-12 03:03:33,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMapReduce 2023-02-12 03:03:33,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,200 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,202 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 03:03:33,216 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:33,216 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:33,216 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:33,217 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:33,217 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:33,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:33,217 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:33,216 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:33,223 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/recovered.edits] 2023-02-12 03:03:33,223 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/recovered.edits] 2023-02-12 03:03:33,223 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/recovered.edits] 2023-02-12 03:03:33,224 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/recovered.edits] 2023-02-12 03:03:33,225 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/recovered.edits] 2023-02-12 03:03:33,225 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/recovered.edits] 2023-02-12 03:03:33,225 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/recovered.edits] 2023-02-12 03:03:33,225 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/recovered.edits] 2023-02-12 03:03:33,240 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/2e1b3171d70240d39da0358eef8dfc86 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/2e1b3171d70240d39da0358eef8dfc86 2023-02-12 03:03:33,241 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/866fd634ca374edc80030ff94f941570 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/866fd634ca374edc80030ff94f941570 2023-02-12 03:03:33,242 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/187c78322b2040beba7d12569ebcb28a to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/187c78322b2040beba7d12569ebcb28a 2023-02-12 03:03:33,242 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/07bd4133dbd64c228646bb42d653f900 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/07bd4133dbd64c228646bb42d653f900 2023-02-12 03:03:33,243 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/a50e074798a54e8f810bdf94537a06c9 2023-02-12 03:03:33,244 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/5a3f2a1e4e7447139bc6e0ba21ce7012 2023-02-12 03:03:33,245 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f1/8b2d65c344984a4e930d10b0ec821393 2023-02-12 03:03:33,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f1/875ed23e10954226bdd0bfe9f1e83f2d 2023-02-12 03:03:33,248 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f1/b616e7d90fb4494f9a514c6b864432f6 2023-02-12 03:03:33,249 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/0adf4929dfcf4f4097b8876427463931 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/0adf4929dfcf4f4097b8876427463931 2023-02-12 03:03:33,250 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f1/203ca1fadb6648e186f3b4c630e01df9 2023-02-12 03:03:33,250 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/bbe0647a663e4f5dbb3d8c83ed348a6c to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f1/bbe0647a663e4f5dbb3d8c83ed348a6c 2023-02-12 03:03:33,251 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/c0334bb714e24f04936a64c884bc8f08 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f1/c0334bb714e24f04936a64c884bc8f08 2023-02-12 03:03:33,252 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/recovered.edits/6.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386/recovered.edits/6.seqid 2023-02-12 03:03:33,255 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/08b8c2eefb84f4c836e45fb106402386 2023-02-12 03:03:33,255 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:33,256 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f1/33e1513472144322b25d9b7be304a403 2023-02-12 03:03:33,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/583d724a442f453daeb84325473e5f2c to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/583d724a442f453daeb84325473e5f2c 2023-02-12 03:03:33,261 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/8b5c623a89b64e039294c0b939641279 2023-02-12 03:03:33,263 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/d3d8e8b515eb4d68a834a743f0726ed8 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/d3d8e8b515eb4d68a834a743f0726ed8 2023-02-12 03:03:33,270 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/08e4be0a434748e7a21f358cb3c6fdcf 2023-02-12 03:03:33,270 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/45a00973d663476b96271974ee4c9d7f 2023-02-12 03:03:33,270 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/recovered.edits] 2023-02-12 03:03:33,272 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/d9352375cac543e88bd6a360bd16e823 2023-02-12 03:03:33,275 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/f2/63086ce1155c494b93c89ea33e61dc3a 2023-02-12 03:03:33,278 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/9f03b3b70406414fac7150ef7459067a to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/f2/9f03b3b70406414fac7150ef7459067a 2023-02-12 03:03:33,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/a73c4fe7564a45aa9031d0c93cdd1342 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/a73c4fe7564a45aa9031d0c93cdd1342 2023-02-12 03:03:33,279 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/ef50e8eeb9154a2780f50ec8373d1b30 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/f2/ef50e8eeb9154a2780f50ec8373d1b30 2023-02-12 03:03:33,279 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/f2/f537de7000ff4a4586fc0ec3657221a7 2023-02-12 03:03:33,280 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/a00c7ef699024986b743874c975af9fe to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/f2/a00c7ef699024986b743874c975af9fe 2023-02-12 03:03:33,282 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/e43484a2923a4a06b71e2340dabf05f7 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/f2/e43484a2923a4a06b71e2340dabf05f7 2023-02-12 03:03:33,285 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/f2/dd97a9dbfe8f428aba0e58689dd2d311 2023-02-12 03:03:33,289 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/68666c9cec344c5681d2898e3a5d2096 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/68666c9cec344c5681d2898e3a5d2096 2023-02-12 03:03:33,289 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be/recovered.edits/12.seqid 2023-02-12 03:03:33,292 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/7a942cbce2c213cc475cee5c2f1052be 2023-02-12 03:03:33,292 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:33,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a/recovered.edits/12.seqid 2023-02-12 03:03:33,293 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982/recovered.edits/12.seqid 2023-02-12 03:03:33,294 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d/recovered.edits/12.seqid 2023-02-12 03:03:33,294 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c/recovered.edits/12.seqid 2023-02-12 03:03:33,294 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/eef95a0c5bc7339cb77860d544dc9e5a 2023-02-12 03:03:33,295 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/619c7547d9d50bf8bd9bec1a5e9a9982 2023-02-12 03:03:33,295 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2/recovered.edits/12.seqid 2023-02-12 03:03:33,295 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/e970f37f3bea46f73188a99d5dfdae6d 2023-02-12 03:03:33,298 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6/recovered.edits/12.seqid 2023-02-12 03:03:33,298 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/659e0262708e2e98371eaa6dd27372d2 2023-02-12 03:03:33,299 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/803b24e2afa27cd17b40934b13589e6c 2023-02-12 03:03:33,300 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f1, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/f2, FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/recovered.edits] 2023-02-12 03:03:33,300 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f1/8244917789014a66b0d3b1bd814b7071 2023-02-12 03:03:33,301 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/a599c2b0174841591718759ffc2587f6 2023-02-12 03:03:33,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 03:03:33,308 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/25a8717cb75f4bffb4c25a5169ce2f01 to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/25a8717cb75f4bffb4c25a5169ce2f01 2023-02-12 03:03:33,311 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/f2/b789a64351974f498d644b1513a18b1e 2023-02-12 03:03:33,314 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/recovered.edits/6.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6/recovered.edits/6.seqid 2023-02-12 03:03:33,315 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/f0b9975c4a68468dd3073b40446983e6 2023-02-12 03:03:33,315 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/recovered.edits/12.seqid to hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/archive/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c/recovered.edits/12.seqid 2023-02-12 03:03:33,319 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/.tmp/data/default/testWithMapReduce/ab86bdcbc077f8bc22a27b110eff135c 2023-02-12 03:03:33,319 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 03:03:33,323 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,355 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-12 03:03:33,359 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676171004090.a599c2b0174841591718759ffc2587f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171013360"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 03:03:33,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08b8c2eefb84f4c836e45fb106402386, NAME => 'testWithMapReduce,,1676171004090.08b8c2eefb84f4c836e45fb106402386.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 803b24e2afa27cd17b40934b13589e6c, NAME => 'testWithMapReduce,aaa,1676171004090.803b24e2afa27cd17b40934b13589e6c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => a599c2b0174841591718759ffc2587f6, NAME => 'testWithMapReduce,d\x84\x84,1676171004090.a599c2b0174841591718759ffc2587f6.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 659e0262708e2e98371eaa6dd27372d2, NAME => 'testWithMapReduce,g\xA7\xA7,1676171004090.659e0262708e2e98371eaa6dd27372d2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => e970f37f3bea46f73188a99d5dfdae6d, NAME => 'testWithMapReduce,j\xCA\xCA,1676171004090.e970f37f3bea46f73188a99d5dfdae6d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 619c7547d9d50bf8bd9bec1a5e9a9982, NAME => 'testWithMapReduce,m\xED\xED,1676171004090.619c7547d9d50bf8bd9bec1a5e9a9982.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => eef95a0c5bc7339cb77860d544dc9e5a, NAME => 'testWithMapReduce,q\x11\x10,1676171004090.eef95a0c5bc7339cb77860d544dc9e5a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 7a942cbce2c213cc475cee5c2f1052be, NAME => 'testWithMapReduce,t43,1676171004090.7a942cbce2c213cc475cee5c2f1052be.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => ab86bdcbc077f8bc22a27b110eff135c, NAME => 'testWithMapReduce,wWV,1676171004090.ab86bdcbc077f8bc22a27b110eff135c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => f0b9975c4a68468dd3073b40446983e6, NAME => 'testWithMapReduce,zz{,1676171004090.f0b9975c4a68468dd3073b40446983e6.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 03:03:33,365 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 03:03:33,365 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171013365"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:33,367 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 03:03:33,369 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:03:33,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 176 msec 2023-02-12 03:03:33,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44827] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 03:03:33,508 INFO [Listener at localhost/42187] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-12 03:03:33,508 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:03:33,509 INFO [Listener at localhost/42187] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:03:33,509 DEBUG [Listener at localhost/42187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x484cbfec to 127.0.0.1:58721 2023-02-12 03:03:33,509 DEBUG [Listener at localhost/42187] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,509 DEBUG [Listener at localhost/42187] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:03:33,509 DEBUG [Listener at localhost/42187] util.JVMClusterUtil(257): Found active master hash=319364939, stopped=false 2023-02-12 03:03:33,509 INFO [Listener at localhost/42187] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:33,513 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:33,513 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:33,513 INFO [Listener at localhost/42187] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:03:33,513 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:33,513 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:33,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:33,515 DEBUG [Listener at localhost/42187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66cf3e17 to 127.0.0.1:58721 2023-02-12 03:03:33,515 DEBUG [Listener at localhost/42187] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:33,515 INFO [Listener at localhost/42187] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39031,1676171000966' ***** 2023-02-12 03:03:33,515 INFO [Listener at localhost/42187] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:33,515 INFO [Listener at localhost/42187] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,34483,1676171001018' ***** 2023-02-12 03:03:33,515 INFO [Listener at localhost/42187] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:33,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:33,516 INFO [RS:0;jenkins-hbase6:39031] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:33,516 INFO [RS:1;jenkins-hbase6:34483] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:33,516 INFO [RS:0;jenkins-hbase6:39031] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:33,516 INFO [RS:1;jenkins-hbase6:34483] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:33,516 INFO [RS:0;jenkins-hbase6:39031] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:33,516 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:33,516 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:33,516 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:33,517 DEBUG [RS:0;jenkins-hbase6:39031] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77f135e5 to 127.0.0.1:58721 2023-02-12 03:03:33,517 DEBUG [RS:0;jenkins-hbase6:39031] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,518 INFO [RS:0;jenkins-hbase6:39031] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:33,518 INFO [RS:0;jenkins-hbase6:39031] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:33,518 INFO [RS:0;jenkins-hbase6:39031] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:33,518 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:03:33,516 INFO [RS:1;jenkins-hbase6:34483] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:33,518 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 03:03:33,518 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(3304): Received CLOSE for 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:33,518 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 03:03:33,518 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 77723931fc6a62c8b723ee4f0b073d16, disabling compactions & flushes 2023-02-12 03:03:33,519 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:33,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:33,519 DEBUG [RS:1;jenkins-hbase6:34483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a347068 to 127.0.0.1:58721 2023-02-12 03:03:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:33,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:33,519 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:33,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:33,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. after waiting 0 ms 2023-02-12 03:03:33,520 DEBUG [RS:1;jenkins-hbase6:34483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:33,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:33,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 77723931fc6a62c8b723ee4f0b073d16 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:03:33,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:33,520 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 03:03:33,521 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1479): Online Regions={77723931fc6a62c8b723ee4f0b073d16=hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16.} 2023-02-12 03:03:33,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-12 03:03:33,521 DEBUG [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 03:03:33,521 DEBUG [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1505): Waiting on 77723931fc6a62c8b723ee4f0b073d16 2023-02-12 03:03:33,524 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 03:03:33,525 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 03:03:33,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/.tmp/info/6e9f9369ea58499899c07d84b171c6ab 2023-02-12 03:03:33,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/info/91067432a0db481992822009a6bdabb1 2023-02-12 03:03:33,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/.tmp/info/6e9f9369ea58499899c07d84b171c6ab as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/info/6e9f9369ea58499899c07d84b171c6ab 2023-02-12 03:03:33,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91067432a0db481992822009a6bdabb1 2023-02-12 03:03:33,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/info/6e9f9369ea58499899c07d84b171c6ab, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:03:33,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 77723931fc6a62c8b723ee4f0b073d16 in 32ms, sequenceid=6, compaction requested=false 2023-02-12 03:03:33,563 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/rep_barrier/da6ec822d61440fbaafb87285c5e8411 2023-02-12 03:03:33,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/namespace/77723931fc6a62c8b723ee4f0b073d16/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:03:33,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:33,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 77723931fc6a62c8b723ee4f0b073d16: Waiting for close lock at 1676171013519Running coprocessor pre-close hooks at 1676171013519Disabling compacts and flushes for region at 1676171013519Disabling writes for close at 1676171013520 (+1 ms)Obtaining lock to block concurrent updates at 1676171013520Preparing flush snapshotting stores in 77723931fc6a62c8b723ee4f0b073d16 at 1676171013520Finished memstore snapshotting hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171013521 (+1 ms)Flushing stores of hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. at 1676171013521Flushing 77723931fc6a62c8b723ee4f0b073d16/info: creating writer at 1676171013522 (+1 ms)Flushing 77723931fc6a62c8b723ee4f0b073d16/info: appending metadata at 1676171013525 (+3 ms)Flushing 77723931fc6a62c8b723ee4f0b073d16/info: closing flushed file at 1676171013525Flushing 77723931fc6a62c8b723ee4f0b073d16/info: reopening flushed file at 1676171013544 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 77723931fc6a62c8b723ee4f0b073d16 in 32ms, sequenceid=6, compaction requested=false at 1676171013552 (+8 ms)Writing region close event to WAL at 1676171013565 (+13 ms)Running coprocessor post-close hooks at 1676171013569 (+4 ms)Closed at 1676171013570 (+1 ms) 2023-02-12 03:03:33,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171003133.77723931fc6a62c8b723ee4f0b073d16. 2023-02-12 03:03:33,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da6ec822d61440fbaafb87285c5e8411 2023-02-12 03:03:33,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/table/0b75cacdaa164267ba35024963e8a7bb 2023-02-12 03:03:33,592 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b75cacdaa164267ba35024963e8a7bb 2023-02-12 03:03:33,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/info/91067432a0db481992822009a6bdabb1 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/info/91067432a0db481992822009a6bdabb1 2023-02-12 03:03:33,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91067432a0db481992822009a6bdabb1 2023-02-12 03:03:33,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/info/91067432a0db481992822009a6bdabb1, entries=30, sequenceid=57, filesize=7.9 K 2023-02-12 03:03:33,602 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:33,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/rep_barrier/da6ec822d61440fbaafb87285c5e8411 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/rep_barrier/da6ec822d61440fbaafb87285c5e8411 2023-02-12 03:03:33,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da6ec822d61440fbaafb87285c5e8411 2023-02-12 03:03:33,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/rep_barrier/da6ec822d61440fbaafb87285c5e8411, entries=10, sequenceid=57, filesize=5.9 K 2023-02-12 03:03:33,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/.tmp/table/0b75cacdaa164267ba35024963e8a7bb as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/table/0b75cacdaa164267ba35024963e8a7bb 2023-02-12 03:03:33,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b75cacdaa164267ba35024963e8a7bb 2023-02-12 03:03:33,619 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/table/0b75cacdaa164267ba35024963e8a7bb, entries=13, sequenceid=57, filesize=5.9 K 2023-02-12 03:03:33,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=57, compaction requested=false 2023-02-12 03:03:33,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 03:03:33,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:33,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:33,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171013518Running coprocessor pre-close hooks at 1676171013518Disabling compacts and flushes for region at 1676171013518Disabling writes for close at 1676171013520 (+2 ms)Obtaining lock to block concurrent updates at 1676171013521 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676171013521Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676171013521Flushing stores of hbase:meta,,1.1588230740 at 1676171013522 (+1 ms)Flushing 1588230740/info: creating writer at 1676171013522Flushing 1588230740/info: appending metadata at 1676171013528 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676171013528Flushing 1588230740/rep_barrier: creating writer at 1676171013544 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171013547 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171013547Flushing 1588230740/table: creating writer at 1676171013572 (+25 ms)Flushing 1588230740/table: appending metadata at 1676171013575 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676171013575Flushing 1588230740/info: reopening flushed file at 1676171013596 (+21 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171013604 (+8 ms)Flushing 1588230740/table: reopening flushed file at 1676171013612 (+8 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=57, compaction requested=false at 1676171013620 (+8 ms)Writing region close event to WAL at 1676171013629 (+9 ms)Running coprocessor post-close hooks at 1676171013633 (+4 ms)Closed at 1676171013634 (+1 ms) 2023-02-12 03:03:33,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:33,721 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39031,1676171000966; all regions closed. 2023-02-12 03:03:33,721 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,34483,1676171001018; all regions closed. 2023-02-12 03:03:33,731 DEBUG [RS:1;jenkins-hbase6:34483] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs 2023-02-12 03:03:33,731 DEBUG [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs 2023-02-12 03:03:33,732 INFO [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39031%2C1676171000966.meta:.meta(num 1676171002841) 2023-02-12 03:03:33,731 INFO [RS:1;jenkins-hbase6:34483] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C34483%2C1676171001018:(num 1676171003543) 2023-02-12 03:03:33,732 DEBUG [RS:1;jenkins-hbase6:34483] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,732 INFO [RS:1;jenkins-hbase6:34483] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:33,732 INFO [RS:1;jenkins-hbase6:34483] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:33,732 INFO [RS:1;jenkins-hbase6:34483] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:33,732 INFO [RS:1;jenkins-hbase6:34483] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:33,732 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:33,732 INFO [RS:1;jenkins-hbase6:34483] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:33,734 INFO [RS:1;jenkins-hbase6:34483] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:34483 2023-02-12 03:03:33,738 DEBUG [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/oldWALs 2023-02-12 03:03:33,738 INFO [RS:0;jenkins-hbase6:39031] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39031%2C1676171000966:(num 1676171003543) 2023-02-12 03:03:33,738 DEBUG [RS:0;jenkins-hbase6:39031] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,738 INFO [RS:0;jenkins-hbase6:39031] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:33,738 INFO [RS:0;jenkins-hbase6:39031] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:33,738 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:33,739 INFO [RS:0;jenkins-hbase6:39031] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39031 2023-02-12 03:03:33,743 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:33,743 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:33,743 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39031,1676171000966 2023-02-12 03:03:33,743 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:33,743 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:33,745 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:33,745 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,34483,1676171001018 2023-02-12 03:03:33,745 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a6b99f0 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:33,746 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,34483,1676171001018] 2023-02-12 03:03:33,745 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e4022f5 rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:33,746 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,34483,1676171001018; numProcessing=1 2023-02-12 03:03:33,748 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,34483,1676171001018 already deleted, retry=false 2023-02-12 03:03:33,748 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,34483,1676171001018 expired; onlineServers=1 2023-02-12 03:03:33,748 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39031,1676171000966] 2023-02-12 03:03:33,748 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39031,1676171000966; numProcessing=2 2023-02-12 03:03:33,749 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39031,1676171000966 already deleted, retry=false 2023-02-12 03:03:33,749 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39031,1676171000966 expired; onlineServers=0 2023-02-12 03:03:33,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44827,1676170999687' ***** 2023-02-12 03:03:33,749 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:03:33,750 DEBUG [M:0;jenkins-hbase6:44827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52341570, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:33,750 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44827,1676170999687 2023-02-12 03:03:33,750 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44827,1676170999687; all regions closed. 2023-02-12 03:03:33,750 DEBUG [M:0;jenkins-hbase6:44827] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:33,750 DEBUG [M:0;jenkins-hbase6:44827] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:03:33,750 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:03:33,750 DEBUG [M:0;jenkins-hbase6:44827] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:03:33,750 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171002295] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171002295,5,FailOnTimeoutGroup] 2023-02-12 03:03:33,751 INFO [M:0;jenkins-hbase6:44827] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:03:33,750 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171002295] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171002295,5,FailOnTimeoutGroup] 2023-02-12 03:03:33,752 INFO [M:0;jenkins-hbase6:44827] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:03:33,752 INFO [M:0;jenkins-hbase6:44827] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:03:33,752 DEBUG [M:0;jenkins-hbase6:44827] master.HMaster(1502): Stopping service threads 2023-02-12 03:03:33,753 INFO [M:0;jenkins-hbase6:44827] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:03:33,753 ERROR [M:0;jenkins-hbase6:44827] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-12 03:03:33,754 INFO [M:0;jenkins-hbase6:44827] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:03:33,754 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:03:33,754 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:33,754 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:33,754 DEBUG [M:0;jenkins-hbase6:44827] zookeeper.ZKUtil(398): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:03:33,755 WARN [M:0;jenkins-hbase6:44827] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:03:33,755 INFO [M:0;jenkins-hbase6:44827] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:03:33,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:33,755 INFO [M:0;jenkins-hbase6:44827] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:03:33,756 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:33,756 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:33,756 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:33,756 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:33,756 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:33,756 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.24 KB heapSize=192.19 KB 2023-02-12 03:03:33,773 INFO [M:0;jenkins-hbase6:44827] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.24 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/08a213582b014a56a90afd7345a75815 2023-02-12 03:03:33,780 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/08a213582b014a56a90afd7345a75815 as hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/08a213582b014a56a90afd7345a75815 2023-02-12 03:03:33,785 INFO [M:0;jenkins-hbase6:44827] regionserver.HStore(1080): Added hdfs://localhost:35265/user/jenkins/test-data/25253443-74f4-ebaf-de79-c1301b605161/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/08a213582b014a56a90afd7345a75815, entries=53, sequenceid=357, filesize=10.4 K 2023-02-12 03:03:33,786 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegion(2947): Finished flush of dataSize ~159.24 KB/163063, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false 2023-02-12 03:03:33,788 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:33,788 DEBUG [M:0;jenkins-hbase6:44827] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171013755Disabling compacts and flushes for region at 1676171013755Disabling writes for close at 1676171013756 (+1 ms)Obtaining lock to block concurrent updates at 1676171013756Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171013756Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163063, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1676171013756Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171013757 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171013758 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171013763 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171013763Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171013781 (+18 ms)Finished flush of dataSize ~159.24 KB/163063, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false at 1676171013786 (+5 ms)Writing region close event to WAL at 1676171013788 (+2 ms)Closed at 1676171013788 2023-02-12 03:03:33,792 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:33,792 INFO [M:0;jenkins-hbase6:44827] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:03:33,793 INFO [M:0;jenkins-hbase6:44827] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44827 2023-02-12 03:03:33,796 DEBUG [M:0;jenkins-hbase6:44827] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,44827,1676170999687 already deleted, retry=false 2023-02-12 03:03:34,015 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,015 INFO [M:0;jenkins-hbase6:44827] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44827,1676170999687; zookeeper connection closed. 2023-02-12 03:03:34,015 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ac865ce rejected from java.util.concurrent.ThreadPoolExecutor@2c4d1e16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,016 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): master:44827-0x10154e8e8250000, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,016 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a4f439d rejected from java.util.concurrent.ThreadPoolExecutor@2c4d1e16[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,115 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,115 INFO [RS:1;jenkins-hbase6:34483] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,34483,1676171001018; zookeeper connection closed. 2023-02-12 03:03:34,116 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@712056ce rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,116 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:34483-0x10154e8e8250002, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,116 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@37a3d6ce] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@37a3d6ce 2023-02-12 03:03:34,116 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@93fb530 rejected from java.util.concurrent.ThreadPoolExecutor@7a7fb9e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,216 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,216 INFO [RS:0;jenkins-hbase6:39031] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39031,1676171000966; zookeeper connection closed. 2023-02-12 03:03:34,216 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ca59173 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,216 DEBUG [Listener at localhost/42187-EventThread] zookeeper.ZKWatcher(600): regionserver:39031-0x10154e8e8250001, quorum=127.0.0.1:58721, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:34,216 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@182c59f6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@182c59f6 2023-02-12 03:03:34,216 ERROR [Listener at localhost/42187-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@548e6515 rejected from java.util.concurrent.ThreadPoolExecutor@4e540465[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:34,217 INFO [Listener at localhost/42187] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:03:34,218 WARN [Listener at localhost/42187] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:34,223 INFO [Listener at localhost/42187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:34,328 WARN [BP-45831180-172.31.2.20-1676170996146 heartbeating to localhost/127.0.0.1:35265] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:34,328 WARN [BP-45831180-172.31.2.20-1676170996146 heartbeating to localhost/127.0.0.1:35265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-45831180-172.31.2.20-1676170996146 (Datanode Uuid c0b66b69-e13b-431d-8ba5-2aa60bd4afa0) service to localhost/127.0.0.1:35265 2023-02-12 03:03:34,330 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/dfs/data/data3/current/BP-45831180-172.31.2.20-1676170996146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:34,330 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/dfs/data/data4/current/BP-45831180-172.31.2.20-1676170996146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:34,332 WARN [Listener at localhost/42187] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:34,334 INFO [Listener at localhost/42187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:34,438 WARN [BP-45831180-172.31.2.20-1676170996146 heartbeating to localhost/127.0.0.1:35265] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:34,438 WARN [BP-45831180-172.31.2.20-1676170996146 heartbeating to localhost/127.0.0.1:35265] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-45831180-172.31.2.20-1676170996146 (Datanode Uuid a0f173a4-058f-4fa5-bdf5-574fb4c49a00) service to localhost/127.0.0.1:35265 2023-02-12 03:03:34,439 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/dfs/data/data1/current/BP-45831180-172.31.2.20-1676170996146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:34,439 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/cluster_219269e5-d0a1-0c42-635d-55be3a3e18df/dfs/data/data2/current/BP-45831180-172.31.2.20-1676170996146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:34,475 INFO [Listener at localhost/42187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:34,596 INFO [Listener at localhost/42187] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:03:34,665 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:03:34,679 INFO [Listener at localhost/42187] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=102 (was 7) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase6:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35265 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,44827,1676170999687)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:35265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@68049ac1 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase6:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:35265 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35265 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase6:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42187 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=531 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5722 (was 6770) 2023-02-12 03:03:34,689 INFO [Listener at localhost/42187] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=102, OpenFileDescriptor=531, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=167, AvailableMemoryMB=5722 2023-02-12 03:03:34,700 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.log.dir so I do NOT create it in target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c 2023-02-12 03:03:34,700 WARN [Listener at localhost/42187] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:03:34,700 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.tmp.dir so I do NOT create it in target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c 2023-02-12 03:03:34,700 WARN [Listener at localhost/42187] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e7df52ba-a0fb-f051-6817-e3f5d6367e3d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:03:34,700 DEBUG [Listener at localhost/42187] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c 2023-02-12 03:03:34,700 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa, deleteOnExit=true 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/test.cache.data in system properties and HBase conf 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:03:34,701 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:03:34,701 DEBUG [Listener at localhost/42187] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:34,702 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:03:34,703 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:03:34,703 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:03:34,703 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:34,703 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:03:34,703 INFO [Listener at localhost/42187] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:03:34,707 WARN [Listener at localhost/42187] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:34,707 WARN [Listener at localhost/42187] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:34,750 WARN [Listener at localhost/42187] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:34,753 INFO [Listener at localhost/42187] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:34,757 INFO [Listener at localhost/42187] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/java.io.tmpdir/Jetty_localhost_37871_hdfs____.cy0xm0/webapp 2023-02-12 03:03:34,851 INFO [Listener at localhost/42187] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37871 2023-02-12 03:03:34,855 WARN [Listener at localhost/42187] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:34,855 WARN [Listener at localhost/42187] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:34,902 WARN [Listener at localhost/37941] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:34,923 WARN [Listener at localhost/37941] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:34,926 WARN [Listener at localhost/37941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:34,928 INFO [Listener at localhost/37941] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:34,933 INFO [Listener at localhost/37941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/java.io.tmpdir/Jetty_localhost_36199_datanode____.btssi3/webapp 2023-02-12 03:03:35,027 INFO [Listener at localhost/37941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36199 2023-02-12 03:03:35,037 WARN [Listener at localhost/39641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:35,056 WARN [Listener at localhost/39641] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:35,062 WARN [Listener at localhost/39641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:35,064 INFO [Listener at localhost/39641] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:35,069 INFO [Listener at localhost/39641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/java.io.tmpdir/Jetty_localhost_34421_datanode____z50ml5/webapp 2023-02-12 03:03:35,156 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe420b3c3643d2377: Processing first storage report for DS-88903b4a-3500-416d-9453-f98ca5b770f6 from datanode 47cab12f-b06d-41ee-89b8-d07131a1f48e 2023-02-12 03:03:35,156 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe420b3c3643d2377: from storage DS-88903b4a-3500-416d-9453-f98ca5b770f6 node DatanodeRegistration(127.0.0.1:40963, datanodeUuid=47cab12f-b06d-41ee-89b8-d07131a1f48e, infoPort=45989, infoSecurePort=0, ipcPort=39641, storageInfo=lv=-57;cid=testClusterID;nsid=621954613;c=1676171014710), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:35,156 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe420b3c3643d2377: Processing first storage report for DS-6b054155-bf05-4639-b3bc-e7c702e4637a from datanode 47cab12f-b06d-41ee-89b8-d07131a1f48e 2023-02-12 03:03:35,156 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe420b3c3643d2377: from storage DS-6b054155-bf05-4639-b3bc-e7c702e4637a node DatanodeRegistration(127.0.0.1:40963, datanodeUuid=47cab12f-b06d-41ee-89b8-d07131a1f48e, infoPort=45989, infoSecurePort=0, ipcPort=39641, storageInfo=lv=-57;cid=testClusterID;nsid=621954613;c=1676171014710), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:35,181 INFO [Listener at localhost/39641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34421 2023-02-12 03:03:35,193 WARN [Listener at localhost/40969] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:35,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe43a492de9c40e1: Processing first storage report for DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6 from datanode ba987207-33a3-4644-9277-18e65f2ac9b1 2023-02-12 03:03:35,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe43a492de9c40e1: from storage DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6 node DatanodeRegistration(127.0.0.1:45947, datanodeUuid=ba987207-33a3-4644-9277-18e65f2ac9b1, infoPort=34143, infoSecurePort=0, ipcPort=40969, storageInfo=lv=-57;cid=testClusterID;nsid=621954613;c=1676171014710), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:35,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbe43a492de9c40e1: Processing first storage report for DS-890ca2ce-25cb-4362-b0dc-b09a8a455882 from datanode ba987207-33a3-4644-9277-18e65f2ac9b1 2023-02-12 03:03:35,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbe43a492de9c40e1: from storage DS-890ca2ce-25cb-4362-b0dc-b09a8a455882 node DatanodeRegistration(127.0.0.1:45947, datanodeUuid=ba987207-33a3-4644-9277-18e65f2ac9b1, infoPort=34143, infoSecurePort=0, ipcPort=40969, storageInfo=lv=-57;cid=testClusterID;nsid=621954613;c=1676171014710), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:35,310 DEBUG [Listener at localhost/40969] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c 2023-02-12 03:03:35,319 INFO [Listener at localhost/40969] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/zookeeper_0, clientPort=57462, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:03:35,322 INFO [Listener at localhost/40969] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57462 2023-02-12 03:03:35,323 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,324 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,355 INFO [Listener at localhost/40969] util.FSUtils(479): Created version file at hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7 with version=8 2023-02-12 03:03:35,355 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,356 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,358 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/hbase-staging 2023-02-12 03:03:35,360 INFO [Listener at localhost/40969] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:35,360 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,360 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,360 INFO [Listener at localhost/40969] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:35,360 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,361 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:35,361 INFO [Listener at localhost/40969] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:35,362 INFO [Listener at localhost/40969] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39959 2023-02-12 03:03:35,363 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,364 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,365 INFO [Listener at localhost/40969] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39959 connecting to ZooKeeper ensemble=127.0.0.1:57462 2023-02-12 03:03:35,381 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:399590x0, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:35,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39959-0x10154e928d80000 connected 2023-02-12 03:03:35,407 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:35,407 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:35,408 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:35,414 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39959 2023-02-12 03:03:35,415 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39959 2023-02-12 03:03:35,421 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39959 2023-02-12 03:03:35,422 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39959 2023-02-12 03:03:35,422 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39959 2023-02-12 03:03:35,423 INFO [Listener at localhost/40969] master.HMaster(439): hbase.rootdir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7, hbase.cluster.distributed=false 2023-02-12 03:03:35,444 INFO [Listener at localhost/40969] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:35,444 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,445 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,445 INFO [Listener at localhost/40969] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:35,445 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,445 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:35,445 INFO [Listener at localhost/40969] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:35,448 INFO [Listener at localhost/40969] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44663 2023-02-12 03:03:35,449 INFO [Listener at localhost/40969] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:35,450 DEBUG [Listener at localhost/40969] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:35,451 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,453 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,454 INFO [Listener at localhost/40969] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44663 connecting to ZooKeeper ensemble=127.0.0.1:57462 2023-02-12 03:03:35,463 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:446630x0, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:35,465 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:446630x0, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:35,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44663-0x10154e928d80001 connected 2023-02-12 03:03:35,466 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:35,466 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:35,467 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 03:03:35,469 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44663 2023-02-12 03:03:35,469 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44663 2023-02-12 03:03:35,470 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 03:03:35,470 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44663 2023-02-12 03:03:35,485 INFO [Listener at localhost/40969] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:35,485 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,486 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,486 INFO [Listener at localhost/40969] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:35,486 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:35,486 INFO [Listener at localhost/40969] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:35,486 INFO [Listener at localhost/40969] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:35,489 INFO [Listener at localhost/40969] ipc.NettyRpcServer(120): Bind to /172.31.2.20:42971 2023-02-12 03:03:35,490 INFO [Listener at localhost/40969] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:35,494 DEBUG [Listener at localhost/40969] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:35,495 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,497 INFO [Listener at localhost/40969] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,498 INFO [Listener at localhost/40969] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42971 connecting to ZooKeeper ensemble=127.0.0.1:57462 2023-02-12 03:03:35,502 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:429710x0, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:35,503 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:429710x0, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:35,504 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:429710x0, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:35,505 DEBUG [Listener at localhost/40969] zookeeper.ZKUtil(164): regionserver:429710x0, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:35,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42971-0x10154e928d80002 connected 2023-02-12 03:03:35,512 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42971 2023-02-12 03:03:35,513 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42971 2023-02-12 03:03:35,514 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42971 2023-02-12 03:03:35,518 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42971 2023-02-12 03:03:35,521 DEBUG [Listener at localhost/40969] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42971 2023-02-12 03:03:35,523 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,525 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:35,525 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,528 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:35,528 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:35,528 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:35,528 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,530 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:35,531 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,39959,1676171015360 from backup master directory 2023-02-12 03:03:35,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:35,532 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,532 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:35,532 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:35,532 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,551 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/hbase.id with ID: 8df5f902-c851-49c7-b8bb-3f415d444bd5 2023-02-12 03:03:35,573 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:35,576 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,589 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x52fa2ae9 to 127.0.0.1:57462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:35,594 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3210a4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:35,594 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:35,594 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:03:35,595 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:35,596 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store-tmp 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:35,612 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:35,612 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:35,612 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171015612Disabling compacts and flushes for region at 1676171015612Disabling writes for close at 1676171015612Writing region close event to WAL at 1676171015612Closed at 1676171015612 2023-02-12 03:03:35,613 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/WALs/jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,616 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39959%2C1676171015360, suffix=, logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/WALs/jenkins-hbase6.apache.org,39959,1676171015360, archiveDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/oldWALs, maxLogs=10 2023-02-12 03:03:35,641 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK] 2023-02-12 03:03:35,641 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK] 2023-02-12 03:03:35,647 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/WALs/jenkins-hbase6.apache.org,39959,1676171015360/jenkins-hbase6.apache.org%2C39959%2C1676171015360.1676171015616 2023-02-12 03:03:35,647 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK], DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK]] 2023-02-12 03:03:35,647 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:35,647 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:35,648 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,648 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,649 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,650 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:03:35,651 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:03:35,651 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:35,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,656 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:35,659 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:35,659 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67981453, jitterRate=0.013002589344978333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:35,659 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171015648Initializing all the Stores at 1676171015649 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171015649Cleaning up temporary data from old regions at 1676171015653 (+4 ms)Cleaning up detritus from prior splits at 1676171015654 (+1 ms)Region opened successfully at 1676171015659 (+5 ms) 2023-02-12 03:03:35,659 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:03:35,661 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:03:35,661 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:03:35,661 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:03:35,661 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:03:35,662 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:03:35,662 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:03:35,667 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:03:35,668 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:03:35,683 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:03:35,683 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:03:35,683 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:03:35,684 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:03:35,684 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:03:35,687 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,687 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:03:35,688 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:03:35,689 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:03:35,690 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:35,690 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,690 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:35,690 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:35,692 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,39959,1676171015360, sessionid=0x10154e928d80000, setting cluster-up flag (Was=false) 2023-02-12 03:03:35,701 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:03:35,702 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,705 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,710 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:03:35,711 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:35,712 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/.tmp 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:35,714 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171045721 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:03:35,721 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:03:35,722 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,722 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:35,723 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:03:35,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:03:35,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:03:35,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:03:35,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:03:35,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:03:35,725 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(952): ClusterId : 8df5f902-c851-49c7-b8bb-3f415d444bd5 2023-02-12 03:03:35,725 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(952): ClusterId : 8df5f902-c851-49c7-b8bb-3f415d444bd5 2023-02-12 03:03:35,725 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:35,725 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:35,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171015725,5,FailOnTimeoutGroup] 2023-02-12 03:03:35,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171015725,5,FailOnTimeoutGroup] 2023-02-12 03:03:35,725 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,726 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:03:35,726 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,726 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,726 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:35,730 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:35,730 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:35,732 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:35,732 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:35,734 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:35,735 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:35,744 DEBUG [RS:1;jenkins-hbase6:42971] zookeeper.ReadOnlyZKClient(139): Connect 0x151048e2 to 127.0.0.1:57462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:35,745 DEBUG [RS:0;jenkins-hbase6:44663] zookeeper.ReadOnlyZKClient(139): Connect 0x21e8557b to 127.0.0.1:57462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:35,758 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:35,759 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:35,759 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7 2023-02-12 03:03:35,759 DEBUG [RS:1;jenkins-hbase6:42971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd7a430, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:35,760 DEBUG [RS:1;jenkins-hbase6:42971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fe82392, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:35,760 DEBUG [RS:0;jenkins-hbase6:44663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f2fbf36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:35,760 DEBUG [RS:0;jenkins-hbase6:44663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b103e0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:35,771 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:44663 2023-02-12 03:03:35,771 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:42971 2023-02-12 03:03:35,771 INFO [RS:0;jenkins-hbase6:44663] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:35,771 INFO [RS:1;jenkins-hbase6:42971] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:35,771 INFO [RS:1;jenkins-hbase6:42971] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:35,771 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:35,771 INFO [RS:0;jenkins-hbase6:44663] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:35,772 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:35,771 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:35,772 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,39959,1676171015360 with isa=jenkins-hbase6.apache.org/172.31.2.20:42971, startcode=1676171015485 2023-02-12 03:03:35,772 DEBUG [RS:1;jenkins-hbase6:42971] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:35,773 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:35,774 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,39959,1676171015360 with isa=jenkins-hbase6.apache.org/172.31.2.20:44663, startcode=1676171015443 2023-02-12 03:03:35,774 DEBUG [RS:0;jenkins-hbase6:44663] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:35,780 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:48861, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:35,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/info 2023-02-12 03:03:35,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,782 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:35,782 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:36675, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:35,783 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7 2023-02-12 03:03:35,783 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37941 2023-02-12 03:03:35,783 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:35,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:35,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:35,783 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7 2023-02-12 03:03:35,783 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37941 2023-02-12 03:03:35,783 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:35,784 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:35,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:35,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:35,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:35,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:35,788 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44663,1676171015443] 2023-02-12 03:03:35,788 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,42971,1676171015485] 2023-02-12 03:03:35,788 DEBUG [RS:1;jenkins-hbase6:42971] zookeeper.ZKUtil(162): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,788 WARN [RS:1;jenkins-hbase6:42971] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:35,789 INFO [RS:1;jenkins-hbase6:42971] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:35,789 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,789 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/table 2023-02-12 03:03:35,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:35,790 DEBUG [RS:0;jenkins-hbase6:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,790 WARN [RS:0;jenkins-hbase6:44663] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:35,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:35,790 INFO [RS:0;jenkins-hbase6:44663] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:35,791 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,792 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740 2023-02-12 03:03:35,796 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740 2023-02-12 03:03:35,799 DEBUG [RS:1;jenkins-hbase6:42971] zookeeper.ZKUtil(162): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,800 DEBUG [RS:1;jenkins-hbase6:42971] zookeeper.ZKUtil(162): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,800 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:35,800 DEBUG [RS:0;jenkins-hbase6:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,801 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:35,801 DEBUG [RS:0;jenkins-hbase6:44663] zookeeper.ZKUtil(162): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,801 INFO [RS:1;jenkins-hbase6:42971] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:35,801 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:35,802 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:35,804 INFO [RS:0;jenkins-hbase6:44663] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:35,806 INFO [RS:1;jenkins-hbase6:42971] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:35,806 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:35,807 INFO [RS:0;jenkins-hbase6:44663] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:35,807 INFO [RS:1;jenkins-hbase6:42971] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:35,807 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60439945, jitterRate=-0.09937463700771332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:35,807 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171015772Initializing all the Stores at 1676171015773 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171015773Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171015773Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171015773Cleaning up temporary data from old regions at 1676171015798 (+25 ms)Cleaning up detritus from prior splits at 1676171015799 (+1 ms)Region opened successfully at 1676171015807 (+8 ms) 2023-02-12 03:03:35,808 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:35,808 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:35,808 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:35,808 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:35,808 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:35,807 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,808 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:35,808 INFO [RS:0;jenkins-hbase6:44663] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:35,809 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:35,809 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,810 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171015808Disabling compacts and flushes for region at 1676171015808Disabling writes for close at 1676171015808Writing region close event to WAL at 1676171015809 (+1 ms)Closed at 1676171015809 2023-02-12 03:03:35,810 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,810 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,810 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,810 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,810 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,810 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,811 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:35,811 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,811 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,811 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,811 DEBUG [RS:1;jenkins-hbase6:42971] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,811 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:35,811 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:35,811 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:03:35,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:03:35,816 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:03:35,816 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,817 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,817 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,818 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:03:35,822 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,823 DEBUG [RS:0;jenkins-hbase6:44663] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:35,824 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,824 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,824 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,832 INFO [RS:1;jenkins-hbase6:42971] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:35,832 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,42971,1676171015485-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,847 INFO [RS:1;jenkins-hbase6:42971] regionserver.Replication(203): jenkins-hbase6.apache.org,42971,1676171015485 started 2023-02-12 03:03:35,847 INFO [RS:0;jenkins-hbase6:44663] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:35,847 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,42971,1676171015485, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:42971, sessionid=0x10154e928d80002 2023-02-12 03:03:35,847 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44663,1676171015443-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:35,847 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:35,847 DEBUG [RS:1;jenkins-hbase6:42971] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,847 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,42971,1676171015485' 2023-02-12 03:03:35,847 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:35,848 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:35,848 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:35,848 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:35,848 DEBUG [RS:1;jenkins-hbase6:42971] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:35,849 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,42971,1676171015485' 2023-02-12 03:03:35,849 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:35,849 DEBUG [RS:1;jenkins-hbase6:42971] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:35,849 DEBUG [RS:1;jenkins-hbase6:42971] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:35,849 INFO [RS:1;jenkins-hbase6:42971] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:35,849 INFO [RS:1;jenkins-hbase6:42971] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:35,866 INFO [RS:0;jenkins-hbase6:44663] regionserver.Replication(203): jenkins-hbase6.apache.org,44663,1676171015443 started 2023-02-12 03:03:35,866 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44663,1676171015443, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44663, sessionid=0x10154e928d80001 2023-02-12 03:03:35,867 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:35,867 DEBUG [RS:0;jenkins-hbase6:44663] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,867 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44663,1676171015443' 2023-02-12 03:03:35,867 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:35,867 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44663,1676171015443' 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:35,868 DEBUG [RS:0;jenkins-hbase6:44663] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:35,869 DEBUG [RS:0;jenkins-hbase6:44663] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:35,869 INFO [RS:0;jenkins-hbase6:44663] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:35,869 INFO [RS:0;jenkins-hbase6:44663] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:35,968 DEBUG [jenkins-hbase6:39959] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:03:35,968 DEBUG [jenkins-hbase6:39959] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:35,970 DEBUG [jenkins-hbase6:39959] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:35,971 DEBUG [jenkins-hbase6:39959] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:35,971 DEBUG [jenkins-hbase6:39959] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:35,972 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,42971,1676171015485, state=OPENING 2023-02-12 03:03:35,974 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:03:35,976 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:35,976 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:35,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:36,131 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:36,132 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:36,134 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:36,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:03:36,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:36,142 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C42971%2C1676171015485.meta, suffix=.meta, logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485, archiveDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs, maxLogs=32 2023-02-12 03:03:36,167 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK] 2023-02-12 03:03:36,167 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK] 2023-02-12 03:03:36,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485/jenkins-hbase6.apache.org%2C42971%2C1676171015485.meta.1676171016144.meta 2023-02-12 03:03:36,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK], DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK]] 2023-02-12 03:03:36,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:36,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:03:36,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:03:36,171 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:03:36,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:03:36,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:03:36,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:03:36,173 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:36,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/info 2023-02-12 03:03:36,174 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/info 2023-02-12 03:03:36,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:36,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:36,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:36,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:36,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:36,177 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:36,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:36,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:36,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/table 2023-02-12 03:03:36,179 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/table 2023-02-12 03:03:36,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:36,180 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:36,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740 2023-02-12 03:03:36,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740 2023-02-12 03:03:36,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:36,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:36,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64076752, jitterRate=-0.045181989669799805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:36,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171016172Writing region info on filesystem at 1676171016172Initializing all the Stores at 1676171016172Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171016173 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171016173Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171016173Cleaning up temporary data from old regions at 1676171016183 (+10 ms)Cleaning up detritus from prior splits at 1676171016184 (+1 ms)Running coprocessor post-open hooks at 1676171016187 (+3 ms)Region opened successfully at 1676171016187 2023-02-12 03:03:36,188 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171016131 2023-02-12 03:03:36,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:03:36,194 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:03:36,194 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,42971,1676171015485, state=OPEN 2023-02-12 03:03:36,196 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:03:36,196 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:36,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:03:36,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,42971,1676171015485 in 220 msec 2023-02-12 03:03:36,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:03:36,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 387 msec 2023-02-12 03:03:36,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 488 msec 2023-02-12 03:03:36,203 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171015525, completionTime=-1 2023-02-12 03:03:36,203 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:03:36,203 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:03:36,206 DEBUG [hconnection-0x51eaad8d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:36,208 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33294, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:36,210 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:03:36,210 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171076210 2023-02-12 03:03:36,210 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171136210 2023-02-12 03:03:36,210 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39959,1676171015360-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39959,1676171015360-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39959,1676171015360-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:39959, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:03:36,217 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:36,219 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:03:36,219 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:03:36,220 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:36,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:36,227 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,227 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716 empty. 2023-02-12 03:03:36,228 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:03:36,240 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:36,241 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b08ff3815bc4684a504ea95f7fb5b716, NAME => 'hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,249 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b08ff3815bc4684a504ea95f7fb5b716, disabling compactions & flushes 2023-02-12 03:03:36,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. after waiting 0 ms 2023-02-12 03:03:36,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b08ff3815bc4684a504ea95f7fb5b716: Waiting for close lock at 1676171016250Disabling compacts and flushes for region at 1676171016250Disabling writes for close at 1676171016250Writing region close event to WAL at 1676171016250Closed at 1676171016250 2023-02-12 03:03:36,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:36,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171016254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171016254"}]},"ts":"1676171016254"} 2023-02-12 03:03:36,257 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:36,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:36,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171016258"}]},"ts":"1676171016258"} 2023-02-12 03:03:36,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:03:36,264 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:36,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:36,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:36,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:36,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b08ff3815bc4684a504ea95f7fb5b716, ASSIGN}] 2023-02-12 03:03:36,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b08ff3815bc4684a504ea95f7fb5b716, ASSIGN 2023-02-12 03:03:36,273 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b08ff3815bc4684a504ea95f7fb5b716, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:36,423 INFO [jenkins-hbase6:39959] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:36,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b08ff3815bc4684a504ea95f7fb5b716, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:36,425 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171016424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171016424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171016424"}]},"ts":"1676171016424"} 2023-02-12 03:03:36,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b08ff3815bc4684a504ea95f7fb5b716, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:36,593 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C42971%2C1676171015485, suffix=, logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485, archiveDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs, maxLogs=32 2023-02-12 03:03:36,670 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK] 2023-02-12 03:03:36,672 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK] 2023-02-12 03:03:36,682 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485/jenkins-hbase6.apache.org%2C42971%2C1676171015485.1676171016596 2023-02-12 03:03:36,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK], DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK]] 2023-02-12 03:03:36,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b08ff3815bc4684a504ea95f7fb5b716, NAME => 'hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:36,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,684 INFO [StoreOpener-b08ff3815bc4684a504ea95f7fb5b716-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,686 DEBUG [StoreOpener-b08ff3815bc4684a504ea95f7fb5b716-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/info 2023-02-12 03:03:36,686 DEBUG [StoreOpener-b08ff3815bc4684a504ea95f7fb5b716-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/info 2023-02-12 03:03:36,686 INFO [StoreOpener-b08ff3815bc4684a504ea95f7fb5b716-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b08ff3815bc4684a504ea95f7fb5b716 columnFamilyName info 2023-02-12 03:03:36,687 INFO [StoreOpener-b08ff3815bc4684a504ea95f7fb5b716-1] regionserver.HStore(310): Store=b08ff3815bc4684a504ea95f7fb5b716/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:36,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:36,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:36,694 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened b08ff3815bc4684a504ea95f7fb5b716; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64754601, jitterRate=-0.035081252455711365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:36,694 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for b08ff3815bc4684a504ea95f7fb5b716: Running coprocessor pre-open hook at 1676171016683Writing region info on filesystem at 1676171016683Initializing all the Stores at 1676171016684 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171016684Cleaning up temporary data from old regions at 1676171016689 (+5 ms)Cleaning up detritus from prior splits at 1676171016690 (+1 ms)Running coprocessor post-open hooks at 1676171016694 (+4 ms)Region opened successfully at 1676171016694 2023-02-12 03:03:36,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716., pid=6, masterSystemTime=1676171016589 2023-02-12 03:03:36,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,698 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:36,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b08ff3815bc4684a504ea95f7fb5b716, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:36,699 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171016699"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171016699"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171016699"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171016699"}]},"ts":"1676171016699"} 2023-02-12 03:03:36,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:03:36,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b08ff3815bc4684a504ea95f7fb5b716, server=jenkins-hbase6.apache.org,42971,1676171015485 in 274 msec 2023-02-12 03:03:36,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:03:36,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b08ff3815bc4684a504ea95f7fb5b716, ASSIGN in 438 msec 2023-02-12 03:03:36,706 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:36,707 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171016706"}]},"ts":"1676171016706"} 2023-02-12 03:03:36,708 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:03:36,710 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:36,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 493 msec 2023-02-12 03:03:36,754 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:03:36,757 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:36,757 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:36,762 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:03:36,771 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:36,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-12 03:03:36,785 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:03:36,793 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:36,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-12 03:03:36,809 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:03:36,813 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.281sec 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39959,1676171015360-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:03:36,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39959,1676171015360-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:03:36,815 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:03:36,854 DEBUG [Listener at localhost/40969] zookeeper.ReadOnlyZKClient(139): Connect 0x30b568ac to 127.0.0.1:57462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:36,859 DEBUG [Listener at localhost/40969] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6964809a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:36,861 DEBUG [hconnection-0x2b64ec75-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:36,864 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:36,866 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:36,867 DEBUG [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:03:36,870 DEBUG [Listener at localhost/40969] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:03:36,871 INFO [RS:0;jenkins-hbase6:44663] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44663%2C1676171015443, suffix=, logDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,44663,1676171015443, archiveDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs, maxLogs=32 2023-02-12 03:03:36,872 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38484, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:03:36,872 INFO [Listener at localhost/40969] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 03:03:36,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-12 03:03:36,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:03:36,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.2.20:38484 deadline: 1676171076873, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 03:03:36,874 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 03:03:36,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:36,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 03:03:36,880 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:36,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 03:03:36,881 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:36,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:36,900 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK] 2023-02-12 03:03:36,902 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK] 2023-02-12 03:03:36,904 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:36,904 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:36,905 INFO [RS:0;jenkins-hbase6:44663] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,44663,1676171015443/jenkins-hbase6.apache.org%2C44663%2C1676171015443.1676171016872 2023-02-12 03:03:36,904 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f empty. 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:36,905 DEBUG [RS:0;jenkins-hbase6:44663] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45947,DS-e931c504-26c3-4e2f-88f7-22af7e78b2c6,DISK], DatanodeInfoWithStorage[127.0.0.1:40963,DS-88903b4a-3500-416d-9453-f98ca5b770f6,DISK]] 2023-02-12 03:03:36,905 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e empty. 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a empty. 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca empty. 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b empty. 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:36,906 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003 empty. 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90 empty. 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6 empty. 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7 empty. 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c empty. 2023-02-12 03:03:36,907 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:36,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:36,908 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:36,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:36,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:36,908 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 03:03:36,922 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:36,924 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5fbb4212596791f04f3d0d6132267f5e, NAME => 'testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 96d4ccfdd3c0485a206673996af397ca, NAME => 'testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c3089990f54d86a73d8f0d48f8d85b5f, NAME => 'testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 96d4ccfdd3c0485a206673996af397ca, disabling compactions & flushes 2023-02-12 03:03:36,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. after waiting 0 ms 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:36,940 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:36,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 96d4ccfdd3c0485a206673996af397ca: Waiting for close lock at 1676171016940Disabling compacts and flushes for region at 1676171016940Disabling writes for close at 1676171016940Writing region close event to WAL at 1676171016940Closed at 1676171016940 2023-02-12 03:03:36,941 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4afbe115a418795c8e20644f0f074003, NAME => 'testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c3089990f54d86a73d8f0d48f8d85b5f, disabling compactions & flushes 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5fbb4212596791f04f3d0d6132267f5e, disabling compactions & flushes 2023-02-12 03:03:36,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. after waiting 0 ms 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. after waiting 0 ms 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:36,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:36,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c3089990f54d86a73d8f0d48f8d85b5f: Waiting for close lock at 1676171016942Disabling compacts and flushes for region at 1676171016942Disabling writes for close at 1676171016942Writing region close event to WAL at 1676171016942Closed at 1676171016942 2023-02-12 03:03:36,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5fbb4212596791f04f3d0d6132267f5e: Waiting for close lock at 1676171016942Disabling compacts and flushes for region at 1676171016942Disabling writes for close at 1676171016942Writing region close event to WAL at 1676171016942Closed at 1676171016942 2023-02-12 03:03:36,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b483db50bb8d91e4e8a489f59331c8b7, NAME => 'testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6f7cfee86cd5934e7ea6b364fa87ca90, NAME => 'testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b483db50bb8d91e4e8a489f59331c8b7, disabling compactions & flushes 2023-02-12 03:03:36,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. after waiting 0 ms 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:36,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:36,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b483db50bb8d91e4e8a489f59331c8b7: Waiting for close lock at 1676171016961Disabling compacts and flushes for region at 1676171016961Disabling writes for close at 1676171016961Writing region close event to WAL at 1676171016961Closed at 1676171016961 2023-02-12 03:03:36,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7ec9d775b089edec9ee11974e984f1a, NAME => 'testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4afbe115a418795c8e20644f0f074003, disabling compactions & flushes 2023-02-12 03:03:36,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:36,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:36,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. after waiting 0 ms 2023-02-12 03:03:36,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:36,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:36,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4afbe115a418795c8e20644f0f074003: Waiting for close lock at 1676171016963Disabling compacts and flushes for region at 1676171016963Disabling writes for close at 1676171016964 (+1 ms)Writing region close event to WAL at 1676171016964Closed at 1676171016964 2023-02-12 03:03:36,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 92cbb8bf131e9fdead5817905c555cc6, NAME => 'testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6f7cfee86cd5934e7ea6b364fa87ca90, disabling compactions & flushes 2023-02-12 03:03:36,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:36,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:36,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. after waiting 0 ms 2023-02-12 03:03:36,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:36,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:36,968 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Waiting for close lock at 1676171016967Disabling compacts and flushes for region at 1676171016967Disabling writes for close at 1676171016968 (+1 ms)Writing region close event to WAL at 1676171016968Closed at 1676171016968 2023-02-12 03:03:36,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ffd3f927a92f2f2cc70dea0f25c9d54b, NAME => 'testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing c7ec9d775b089edec9ee11974e984f1a, disabling compactions & flushes 2023-02-12 03:03:36,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. after waiting 0 ms 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:36,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:36,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for c7ec9d775b089edec9ee11974e984f1a: Waiting for close lock at 1676171016985Disabling compacts and flushes for region at 1676171016985Disabling writes for close at 1676171016985Writing region close event to WAL at 1676171016985Closed at 1676171016985 2023-02-12 03:03:36,986 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b7e0f1682e64d68a3b101725f74760c, NAME => 'testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.tmp 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2b7e0f1682e64d68a3b101725f74760c, disabling compactions & flushes 2023-02-12 03:03:36,999 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. after waiting 0 ms 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:36,999 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:36,999 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2b7e0f1682e64d68a3b101725f74760c: Waiting for close lock at 1676171016999Disabling compacts and flushes for region at 1676171016999Disabling writes for close at 1676171016999Writing region close event to WAL at 1676171016999Closed at 1676171016999 2023-02-12 03:03:37,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 92cbb8bf131e9fdead5817905c555cc6, disabling compactions & flushes 2023-02-12 03:03:37,387 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. after waiting 0 ms 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,387 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,387 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 92cbb8bf131e9fdead5817905c555cc6: Waiting for close lock at 1676171017387Disabling compacts and flushes for region at 1676171017387Disabling writes for close at 1676171017387Writing region close event to WAL at 1676171017387Closed at 1676171017387 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ffd3f927a92f2f2cc70dea0f25c9d54b, disabling compactions & flushes 2023-02-12 03:03:37,389 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. after waiting 0 ms 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,389 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Waiting for close lock at 1676171017389Disabling compacts and flushes for region at 1676171017389Disabling writes for close at 1676171017389Writing region close event to WAL at 1676171017389Closed at 1676171017389 2023-02-12 03:03:37,392 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:37,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,394 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,395 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171017394"}]},"ts":"1676171017394"} 2023-02-12 03:03:37,407 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 03:03:37,409 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:37,410 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171017409"}]},"ts":"1676171017409"} 2023-02-12 03:03:37,412 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 03:03:37,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:37,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:37,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:37,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:37,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c3089990f54d86a73d8f0d48f8d85b5f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbb4212596791f04f3d0d6132267f5e, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96d4ccfdd3c0485a206673996af397ca, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4afbe115a418795c8e20644f0f074003, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b483db50bb8d91e4e8a489f59331c8b7, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6f7cfee86cd5934e7ea6b364fa87ca90, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7ec9d775b089edec9ee11974e984f1a, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92cbb8bf131e9fdead5817905c555cc6, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ffd3f927a92f2f2cc70dea0f25c9d54b, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b7e0f1682e64d68a3b101725f74760c, ASSIGN}] 2023-02-12 03:03:37,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5fbb4212596791f04f3d0d6132267f5e, ASSIGN 2023-02-12 03:03:37,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96d4ccfdd3c0485a206673996af397ca, ASSIGN 2023-02-12 03:03:37,429 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c3089990f54d86a73d8f0d48f8d85b5f, ASSIGN 2023-02-12 03:03:37,429 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4afbe115a418795c8e20644f0f074003, ASSIGN 2023-02-12 03:03:37,429 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5fbb4212596791f04f3d0d6132267f5e, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:37,430 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=96d4ccfdd3c0485a206673996af397ca, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:37,430 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4afbe115a418795c8e20644f0f074003, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:37,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c3089990f54d86a73d8f0d48f8d85b5f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44663,1676171015443; forceNewPlan=false, retain=false 2023-02-12 03:03:37,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b7e0f1682e64d68a3b101725f74760c, ASSIGN 2023-02-12 03:03:37,430 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ffd3f927a92f2f2cc70dea0f25c9d54b, ASSIGN 2023-02-12 03:03:37,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92cbb8bf131e9fdead5817905c555cc6, ASSIGN 2023-02-12 03:03:37,431 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c7ec9d775b089edec9ee11974e984f1a, ASSIGN 2023-02-12 03:03:37,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2b7e0f1682e64d68a3b101725f74760c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44663,1676171015443; forceNewPlan=false, retain=false 2023-02-12 03:03:37,431 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ffd3f927a92f2f2cc70dea0f25c9d54b, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44663,1676171015443; forceNewPlan=false, retain=false 2023-02-12 03:03:37,431 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=92cbb8bf131e9fdead5817905c555cc6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:37,432 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6f7cfee86cd5934e7ea6b364fa87ca90, ASSIGN 2023-02-12 03:03:37,432 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c7ec9d775b089edec9ee11974e984f1a, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,42971,1676171015485; forceNewPlan=false, retain=false 2023-02-12 03:03:37,432 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b483db50bb8d91e4e8a489f59331c8b7, ASSIGN 2023-02-12 03:03:37,433 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6f7cfee86cd5934e7ea6b364fa87ca90, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44663,1676171015443; forceNewPlan=false, retain=false 2023-02-12 03:03:37,433 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b483db50bb8d91e4e8a489f59331c8b7, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44663,1676171015443; forceNewPlan=false, retain=false 2023-02-12 03:03:37,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:37,580 INFO [jenkins-hbase6:39959] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 03:03:37,585 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6f7cfee86cd5934e7ea6b364fa87ca90, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b483db50bb8d91e4e8a489f59331c8b7, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c3089990f54d86a73d8f0d48f8d85b5f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017585"}]},"ts":"1676171017585"} 2023-02-12 03:03:37,585 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b7e0f1682e64d68a3b101725f74760c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017585"}]},"ts":"1676171017585"} 2023-02-12 03:03:37,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017585"}]},"ts":"1676171017585"} 2023-02-12 03:03:37,585 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017585"}]},"ts":"1676171017585"} 2023-02-12 03:03:37,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ffd3f927a92f2f2cc70dea0f25c9d54b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,587 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017585"}]},"ts":"1676171017585"} 2023-02-12 03:03:37,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure b483db50bb8d91e4e8a489f59331c8b7, server=jenkins-hbase6.apache.org,44663,1676171015443}] 2023-02-12 03:03:37,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure c3089990f54d86a73d8f0d48f8d85b5f, server=jenkins-hbase6.apache.org,44663,1676171015443}] 2023-02-12 03:03:37,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 2b7e0f1682e64d68a3b101725f74760c, server=jenkins-hbase6.apache.org,44663,1676171015443}] 2023-02-12 03:03:37,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 6f7cfee86cd5934e7ea6b364fa87ca90, server=jenkins-hbase6.apache.org,44663,1676171015443}] 2023-02-12 03:03:37,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure ffd3f927a92f2f2cc70dea0f25c9d54b, server=jenkins-hbase6.apache.org,44663,1676171015443}] 2023-02-12 03:03:37,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=96d4ccfdd3c0485a206673996af397ca, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,599 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c7ec9d775b089edec9ee11974e984f1a, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5fbb4212596791f04f3d0d6132267f5e, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017599"}]},"ts":"1676171017599"} 2023-02-12 03:03:37,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017599"}]},"ts":"1676171017599"} 2023-02-12 03:03:37,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017599"}]},"ts":"1676171017599"} 2023-02-12 03:03:37,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 96d4ccfdd3c0485a206673996af397ca, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:37,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=92cbb8bf131e9fdead5817905c555cc6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017601"}]},"ts":"1676171017601"} 2023-02-12 03:03:37,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure c7ec9d775b089edec9ee11974e984f1a, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:37,605 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4afbe115a418795c8e20644f0f074003, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,605 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171017605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171017605"}]},"ts":"1676171017605"} 2023-02-12 03:03:37,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 5fbb4212596791f04f3d0d6132267f5e, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:37,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 92cbb8bf131e9fdead5817905c555cc6, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:37,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 4afbe115a418795c8e20644f0f074003, server=jenkins-hbase6.apache.org,42971,1676171015485}] 2023-02-12 03:03:37,743 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,744 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:37,747 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:37,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:37,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b483db50bb8d91e4e8a489f59331c8b7, NAME => 'testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 03:03:37,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,753 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,754 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1 2023-02-12 03:03:37,754 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1 2023-02-12 03:03:37,755 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b483db50bb8d91e4e8a489f59331c8b7 columnFamilyName f1 2023-02-12 03:03:37,756 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(310): Store=b483db50bb8d91e4e8a489f59331c8b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,756 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,757 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2 2023-02-12 03:03:37,757 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2 2023-02-12 03:03:37,758 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b483db50bb8d91e4e8a489f59331c8b7 columnFamilyName f2 2023-02-12 03:03:37,759 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(310): Store=b483db50bb8d91e4e8a489f59331c8b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:37,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5fbb4212596791f04f3d0d6132267f5e, NAME => 'testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 03:03:37,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,763 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:37,764 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1 2023-02-12 03:03:37,764 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1 2023-02-12 03:03:37,765 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbb4212596791f04f3d0d6132267f5e columnFamilyName f1 2023-02-12 03:03:37,765 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(310): Store=5fbb4212596791f04f3d0d6132267f5e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,766 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened b483db50bb8d91e4e8a489f59331c8b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65389745, jitterRate=-0.02561686933040619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for b483db50bb8d91e4e8a489f59331c8b7: Running coprocessor pre-open hook at 1676171017752Writing region info on filesystem at 1676171017752Initializing all the Stores at 1676171017753 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017753Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017753Cleaning up temporary data from old regions at 1676171017761 (+8 ms)Cleaning up detritus from prior splits at 1676171017761Running coprocessor post-open hooks at 1676171017768 (+7 ms)Region opened successfully at 1676171017768 2023-02-12 03:03:37,768 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2 2023-02-12 03:03:37,768 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2 2023-02-12 03:03:37,768 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbb4212596791f04f3d0d6132267f5e columnFamilyName f2 2023-02-12 03:03:37,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7., pid=21, masterSystemTime=1676171017743 2023-02-12 03:03:37,769 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(310): Store=5fbb4212596791f04f3d0d6132267f5e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:37,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:37,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:37,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c3089990f54d86a73d8f0d48f8d85b5f, NAME => 'testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 03:03:37,776 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b483db50bb8d91e4e8a489f59331c8b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,776 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017776"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017776"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017776"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017776"}]},"ts":"1676171017776"} 2023-02-12 03:03:37,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:37,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-12 03:03:37,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure b483db50bb8d91e4e8a489f59331c8b7, server=jenkins-hbase6.apache.org,44663,1676171015443 in 191 msec 2023-02-12 03:03:37,782 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b483db50bb8d91e4e8a489f59331c8b7, ASSIGN in 356 msec 2023-02-12 03:03:37,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 5fbb4212596791f04f3d0d6132267f5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71441885, jitterRate=0.06456704437732697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 5fbb4212596791f04f3d0d6132267f5e: Running coprocessor pre-open hook at 1676171017762Writing region info on filesystem at 1676171017762Initializing all the Stores at 1676171017762Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017762Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017763 (+1 ms)Cleaning up temporary data from old regions at 1676171017772 (+9 ms)Cleaning up detritus from prior splits at 1676171017773 (+1 ms)Running coprocessor post-open hooks at 1676171017783 (+10 ms)Region opened successfully at 1676171017783 2023-02-12 03:03:37,783 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f1 2023-02-12 03:03:37,783 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f1 2023-02-12 03:03:37,784 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3089990f54d86a73d8f0d48f8d85b5f columnFamilyName f1 2023-02-12 03:03:37,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e., pid=28, masterSystemTime=1676171017757 2023-02-12 03:03:37,784 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(310): Store=c3089990f54d86a73d8f0d48f8d85b5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,785 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:37,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:37,788 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f2 2023-02-12 03:03:37,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:37,790 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5fbb4212596791f04f3d0d6132267f5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,789 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f2 2023-02-12 03:03:37,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 96d4ccfdd3c0485a206673996af397ca, NAME => 'testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 03:03:37,792 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017789"}]},"ts":"1676171017789"} 2023-02-12 03:03:37,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,793 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3089990f54d86a73d8f0d48f8d85b5f columnFamilyName f2 2023-02-12 03:03:37,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,793 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(310): Store=c3089990f54d86a73d8f0d48f8d85b5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,794 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,796 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1 2023-02-12 03:03:37,796 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1 2023-02-12 03:03:37,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-12 03:03:37,796 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96d4ccfdd3c0485a206673996af397ca columnFamilyName f1 2023-02-12 03:03:37,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 5fbb4212596791f04f3d0d6132267f5e, server=jenkins-hbase6.apache.org,42971,1676171015485 in 188 msec 2023-02-12 03:03:37,797 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(310): Store=96d4ccfdd3c0485a206673996af397ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,797 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5fbb4212596791f04f3d0d6132267f5e, ASSIGN in 372 msec 2023-02-12 03:03:37,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:37,799 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2 2023-02-12 03:03:37,799 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2 2023-02-12 03:03:37,799 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96d4ccfdd3c0485a206673996af397ca columnFamilyName f2 2023-02-12 03:03:37,800 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(310): Store=96d4ccfdd3c0485a206673996af397ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened c3089990f54d86a73d8f0d48f8d85b5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68525583, jitterRate=0.021110758185386658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for c3089990f54d86a73d8f0d48f8d85b5f: Running coprocessor pre-open hook at 1676171017777Writing region info on filesystem at 1676171017777Initializing all the Stores at 1676171017779 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017779Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017782 (+3 ms)Cleaning up temporary data from old regions at 1676171017796 (+14 ms)Cleaning up detritus from prior splits at 1676171017796Running coprocessor post-open hooks at 1676171017802 (+6 ms)Region opened successfully at 1676171017802 2023-02-12 03:03:37,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f., pid=22, masterSystemTime=1676171017743 2023-02-12 03:03:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:37,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:37,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b7e0f1682e64d68a3b101725f74760c, NAME => 'testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 03:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,805 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c3089990f54d86a73d8f0d48f8d85b5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,805 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017805"}]},"ts":"1676171017805"} 2023-02-12 03:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,806 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-12 03:03:37,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure c3089990f54d86a73d8f0d48f8d85b5f, server=jenkins-hbase6.apache.org,44663,1676171015443 in 218 msec 2023-02-12 03:03:37,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c3089990f54d86a73d8f0d48f8d85b5f, ASSIGN in 384 msec 2023-02-12 03:03:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,811 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f1 2023-02-12 03:03:37,811 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f1 2023-02-12 03:03:37,812 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b7e0f1682e64d68a3b101725f74760c columnFamilyName f1 2023-02-12 03:03:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:37,812 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(310): Store=2b7e0f1682e64d68a3b101725f74760c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,812 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,814 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f2 2023-02-12 03:03:37,814 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f2 2023-02-12 03:03:37,814 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b7e0f1682e64d68a3b101725f74760c columnFamilyName f2 2023-02-12 03:03:37,815 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(310): Store=2b7e0f1682e64d68a3b101725f74760c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 96d4ccfdd3c0485a206673996af397ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75171747, jitterRate=0.12014631927013397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 96d4ccfdd3c0485a206673996af397ca: Running coprocessor pre-open hook at 1676171017793Writing region info on filesystem at 1676171017793Initializing all the Stores at 1676171017794 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017794Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017794Cleaning up temporary data from old regions at 1676171017806 (+12 ms)Cleaning up detritus from prior splits at 1676171017806Running coprocessor post-open hooks at 1676171017820 (+14 ms)Region opened successfully at 1676171017820 2023-02-12 03:03:37,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca., pid=26, masterSystemTime=1676171017757 2023-02-12 03:03:37,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:37,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:37,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92cbb8bf131e9fdead5817905c555cc6, NAME => 'testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 03:03:37,823 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=96d4ccfdd3c0485a206673996af397ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,823 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017823"}]},"ts":"1676171017823"} 2023-02-12 03:03:37,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,827 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-12 03:03:37,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 96d4ccfdd3c0485a206673996af397ca, server=jenkins-hbase6.apache.org,42971,1676171015485 in 224 msec 2023-02-12 03:03:37,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 2b7e0f1682e64d68a3b101725f74760c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68522737, jitterRate=0.021068349480628967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 2b7e0f1682e64d68a3b101725f74760c: Running coprocessor pre-open hook at 1676171017805Writing region info on filesystem at 1676171017805Initializing all the Stores at 1676171017806 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017806Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017806Cleaning up temporary data from old regions at 1676171017821 (+15 ms)Cleaning up detritus from prior splits at 1676171017821Running coprocessor post-open hooks at 1676171017828 (+7 ms)Region opened successfully at 1676171017828 2023-02-12 03:03:37,829 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1 2023-02-12 03:03:37,829 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1 2023-02-12 03:03:37,829 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92cbb8bf131e9fdead5817905c555cc6 columnFamilyName f1 2023-02-12 03:03:37,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c., pid=23, masterSystemTime=1676171017743 2023-02-12 03:03:37,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=96d4ccfdd3c0485a206673996af397ca, ASSIGN in 403 msec 2023-02-12 03:03:37,830 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(310): Store=92cbb8bf131e9fdead5817905c555cc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,830 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:37,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:37,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6f7cfee86cd5934e7ea6b364fa87ca90, NAME => 'testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 03:03:37,831 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2 2023-02-12 03:03:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,832 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b7e0f1682e64d68a3b101725f74760c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,832 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2 2023-02-12 03:03:37,833 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676171017832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017832"}]},"ts":"1676171017832"} 2023-02-12 03:03:37,833 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92cbb8bf131e9fdead5817905c555cc6 columnFamilyName f2 2023-02-12 03:03:37,834 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(310): Store=92cbb8bf131e9fdead5817905c555cc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-12 03:03:37,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 2b7e0f1682e64d68a3b101725f74760c, server=jenkins-hbase6.apache.org,44663,1676171015443 in 245 msec 2023-02-12 03:03:37,837 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2b7e0f1682e64d68a3b101725f74760c, ASSIGN in 412 msec 2023-02-12 03:03:37,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,839 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1 2023-02-12 03:03:37,839 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1 2023-02-12 03:03:37,839 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f7cfee86cd5934e7ea6b364fa87ca90 columnFamilyName f1 2023-02-12 03:03:37,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:37,840 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(310): Store=6f7cfee86cd5934e7ea6b364fa87ca90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,840 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,843 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2 2023-02-12 03:03:37,843 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2 2023-02-12 03:03:37,843 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f7cfee86cd5934e7ea6b364fa87ca90 columnFamilyName f2 2023-02-12 03:03:37,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,844 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(310): Store=6f7cfee86cd5934e7ea6b364fa87ca90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 92cbb8bf131e9fdead5817905c555cc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59365316, jitterRate=-0.11538785696029663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 92cbb8bf131e9fdead5817905c555cc6: Running coprocessor pre-open hook at 1676171017824Writing region info on filesystem at 1676171017824Initializing all the Stores at 1676171017825 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017825Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017826 (+1 ms)Cleaning up temporary data from old regions at 1676171017836 (+10 ms)Cleaning up detritus from prior splits at 1676171017837 (+1 ms)Running coprocessor post-open hooks at 1676171017844 (+7 ms)Region opened successfully at 1676171017844 2023-02-12 03:03:37,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6., pid=29, masterSystemTime=1676171017757 2023-02-12 03:03:37,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:37,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7ec9d775b089edec9ee11974e984f1a, NAME => 'testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 03:03:37,848 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=92cbb8bf131e9fdead5817905c555cc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,848 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017848"}]},"ts":"1676171017848"} 2023-02-12 03:03:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:37,850 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,852 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1 2023-02-12 03:03:37,852 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1 2023-02-12 03:03:37,852 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7ec9d775b089edec9ee11974e984f1a columnFamilyName f1 2023-02-12 03:03:37,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-12 03:03:37,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 92cbb8bf131e9fdead5817905c555cc6, server=jenkins-hbase6.apache.org,42971,1676171015485 in 243 msec 2023-02-12 03:03:37,854 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(310): Store=c7ec9d775b089edec9ee11974e984f1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,854 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92cbb8bf131e9fdead5817905c555cc6, ASSIGN in 428 msec 2023-02-12 03:03:37,855 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2 2023-02-12 03:03:37,856 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2 2023-02-12 03:03:37,856 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7ec9d775b089edec9ee11974e984f1a columnFamilyName f2 2023-02-12 03:03:37,856 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(310): Store=c7ec9d775b089edec9ee11974e984f1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 6f7cfee86cd5934e7ea6b364fa87ca90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71409130, jitterRate=0.06407895684242249}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Running coprocessor pre-open hook at 1676171017832Writing region info on filesystem at 1676171017832Initializing all the Stores at 1676171017834 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017834Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017834Cleaning up temporary data from old regions at 1676171017846 (+12 ms)Cleaning up detritus from prior splits at 1676171017846Running coprocessor post-open hooks at 1676171017860 (+14 ms)Region opened successfully at 1676171017860 2023-02-12 03:03:37,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90., pid=24, masterSystemTime=1676171017743 2023-02-12 03:03:37,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:37,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:37,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ffd3f927a92f2f2cc70dea0f25c9d54b, NAME => 'testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 03:03:37,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=6f7cfee86cd5934e7ea6b364fa87ca90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017864"}]},"ts":"1676171017864"} 2023-02-12 03:03:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,866 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,867 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1 2023-02-12 03:03:37,867 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1 2023-02-12 03:03:37,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,868 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffd3f927a92f2f2cc70dea0f25c9d54b columnFamilyName f1 2023-02-12 03:03:37,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-12 03:03:37,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 6f7cfee86cd5934e7ea6b364fa87ca90, server=jenkins-hbase6.apache.org,44663,1676171015443 in 274 msec 2023-02-12 03:03:37,868 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(310): Store=ffd3f927a92f2f2cc70dea0f25c9d54b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,869 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6f7cfee86cd5934e7ea6b364fa87ca90, ASSIGN in 443 msec 2023-02-12 03:03:37,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:37,870 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2 2023-02-12 03:03:37,870 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2 2023-02-12 03:03:37,871 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffd3f927a92f2f2cc70dea0f25c9d54b columnFamilyName f2 2023-02-12 03:03:37,871 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(310): Store=ffd3f927a92f2f2cc70dea0f25c9d54b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened c7ec9d775b089edec9ee11974e984f1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62691778, jitterRate=-0.06581971049308777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for c7ec9d775b089edec9ee11974e984f1a: Running coprocessor pre-open hook at 1676171017848Writing region info on filesystem at 1676171017848Initializing all the Stores at 1676171017849 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017849Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017850 (+1 ms)Cleaning up temporary data from old regions at 1676171017862 (+12 ms)Cleaning up detritus from prior splits at 1676171017862Running coprocessor post-open hooks at 1676171017872 (+10 ms)Region opened successfully at 1676171017872 2023-02-12 03:03:37,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a., pid=27, masterSystemTime=1676171017757 2023-02-12 03:03:37,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:37,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:37,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:37,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4afbe115a418795c8e20644f0f074003, NAME => 'testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 03:03:37,875 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c7ec9d775b089edec9ee11974e984f1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017875"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017875"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017875"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017875"}]},"ts":"1676171017875"} 2023-02-12 03:03:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:37,877 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,879 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1 2023-02-12 03:03:37,879 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1 2023-02-12 03:03:37,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-12 03:03:37,880 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4afbe115a418795c8e20644f0f074003 columnFamilyName f1 2023-02-12 03:03:37,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure c7ec9d775b089edec9ee11974e984f1a, server=jenkins-hbase6.apache.org,42971,1676171015485 in 273 msec 2023-02-12 03:03:37,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened ffd3f927a92f2f2cc70dea0f25c9d54b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61056870, jitterRate=-0.09018173813819885}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Running coprocessor pre-open hook at 1676171017864Writing region info on filesystem at 1676171017864Initializing all the Stores at 1676171017865 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017865Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017865Cleaning up temporary data from old regions at 1676171017873 (+8 ms)Cleaning up detritus from prior splits at 1676171017874 (+1 ms)Running coprocessor post-open hooks at 1676171017880 (+6 ms)Region opened successfully at 1676171017880 2023-02-12 03:03:37,881 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(310): Store=4afbe115a418795c8e20644f0f074003/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,881 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b., pid=25, masterSystemTime=1676171017743 2023-02-12 03:03:37,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c7ec9d775b089edec9ee11974e984f1a, ASSIGN in 455 msec 2023-02-12 03:03:37,883 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2 2023-02-12 03:03:37,883 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2 2023-02-12 03:03:37,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:37,883 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4afbe115a418795c8e20644f0f074003 columnFamilyName f2 2023-02-12 03:03:37,883 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ffd3f927a92f2f2cc70dea0f25c9d54b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:37,884 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017883"}]},"ts":"1676171017883"} 2023-02-12 03:03:37,884 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(310): Store=4afbe115a418795c8e20644f0f074003/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:37,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-12 03:03:37,888 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure ffd3f927a92f2f2cc70dea0f25c9d54b, server=jenkins-hbase6.apache.org,44663,1676171015443 in 289 msec 2023-02-12 03:03:37,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:37,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ffd3f927a92f2f2cc70dea0f25c9d54b, ASSIGN in 463 msec 2023-02-12 03:03:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:37,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:37,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 4afbe115a418795c8e20644f0f074003; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67871597, jitterRate=0.011365607380867004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:37,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 4afbe115a418795c8e20644f0f074003: Running coprocessor pre-open hook at 1676171017876Writing region info on filesystem at 1676171017876Initializing all the Stores at 1676171017877 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017877Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171017877Cleaning up temporary data from old regions at 1676171017886 (+9 ms)Cleaning up detritus from prior splits at 1676171017887 (+1 ms)Running coprocessor post-open hooks at 1676171017892 (+5 ms)Region opened successfully at 1676171017892 2023-02-12 03:03:37,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003., pid=30, masterSystemTime=1676171017757 2023-02-12 03:03:37,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:37,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:37,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4afbe115a418795c8e20644f0f074003, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:37,895 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676171017895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171017895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171017895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171017895"}]},"ts":"1676171017895"} 2023-02-12 03:03:37,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-12 03:03:37,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 4afbe115a418795c8e20644f0f074003, server=jenkins-hbase6.apache.org,42971,1676171015485 in 288 msec 2023-02-12 03:03:37,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-12 03:03:37,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4afbe115a418795c8e20644f0f074003, ASSIGN in 473 msec 2023-02-12 03:03:37,901 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:37,901 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171017901"}]},"ts":"1676171017901"} 2023-02-12 03:03:37,903 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 03:03:37,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:37,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.0300 sec 2023-02-12 03:03:37,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:37,992 INFO [Listener at localhost/40969] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 03:03:37,992 DEBUG [Listener at localhost/40969] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 03:03:37,992 INFO [Listener at localhost/40969] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:37,997 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 03:03:37,997 INFO [Listener at localhost/40969] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:37,998 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 03:03:37,998 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:03:38,074 DEBUG [hconnection-0x2b64ec75-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:38,099 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:38,112 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44663] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:38,116 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42971] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:38,257 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:03:38,257 INFO [Listener at localhost/40969] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:03:38,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:38,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171018259 (current time:1676171018259). 2023-02-12 03:03:38,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:03:38,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] zookeeper.ReadOnlyZKClient(139): Connect 0x1cc4c6b0 to 127.0.0.1:57462 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:38,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a0060f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:38,270 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:38,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cc4c6b0 to 127.0.0.1:57462 2023-02-12 03:03:38,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:03:38,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:38,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:38,276 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:38,277 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676171618277 2023-02-12 03:03:38,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:03:38,278 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 03:03:38,280 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:03:38,280 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:38,280 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:03:38,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:38,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-12 03:03:38,282 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:38,283 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676171618283 2023-02-12 03:03:38,294 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:03:38,381 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:38,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:38,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:38,383 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:03:38,583 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:38,585 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:03:38,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,718 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-12 03:03:38,718 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:38,718 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-12 03:03:38,718 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-12 03:03:38,719 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,719 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,720 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:38,720 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:38,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:38,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:38,720 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,721 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,721 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,721 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,721 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,722 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 03:03:38,722 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 03:03:38,722 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:38,722 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:38,723 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 03:03:38,724 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 03:03:38,724 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 03:03:38,724 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 03:03:38,724 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44663,1676171015443' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 03:03:38,724 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,42971,1676171015485' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 03:03:38,726 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,726 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:38,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:38,727 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:38,727 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,727 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,727 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:38,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:38,728 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,728 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:38,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44663,1676171015443' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 03:03:38,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45098587[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:38,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:38,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,42971,1676171015485' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 03:03:38,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45098587[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:38,733 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-12 03:03:38,733 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,734 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,734 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,735 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:38,735 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:38,735 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:38,735 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:38,735 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. started... 2023-02-12 03:03:38,735 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:38,735 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2b7e0f1682e64d68a3b101725f74760c: 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. started... 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. started... 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:38,736 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:38,743 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:38,743 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 96d4ccfdd3c0485a206673996af397ca 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:38,743 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:38,743 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6f7cfee86cd5934e7ea6b364fa87ca90 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:38,743 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:38,743 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. started... 2023-02-12 03:03:38,745 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:38,745 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:38,745 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:38,745 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:38,745 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. started... 2023-02-12 03:03:38,745 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. started... 2023-02-12 03:03:38,748 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c7ec9d775b089edec9ee11974e984f1a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:38,745 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 92cbb8bf131e9fdead5817905c555cc6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:38,749 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ffd3f927a92f2f2cc70dea0f25c9d54b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:38,802 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. completed. 2023-02-12 03:03:38,803 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:38,803 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:38,803 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. started... 2023-02-12 03:03:38,803 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:38,806 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b483db50bb8d91e4e8a489f59331c8b7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:38,827 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f1/32a21e90f61549e28454844e835dfff3 2023-02-12 03:03:38,828 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f1/5eb4866397b3423ba81f1d60e2b1588a 2023-02-12 03:03:38,847 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f1/705c71b4ce3c43c2840ddbe0613bc220 2023-02-12 03:03:38,863 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f1/0dfe611c3af84455937655fdbdb283e3 2023-02-12 03:03:38,870 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f1/816567aef3c347668f0f7c14a05675e2 2023-02-12 03:03:38,887 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:38,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:38,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:38,893 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 03:03:38,911 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f1/df674d211227416ab5e1c765d87bcaac 2023-02-12 03:03:38,931 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f2/93a7621ef89146c0873f8d2a28936f10 2023-02-12 03:03:38,932 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f2/e443c0ef818240b68a7c7d284c174f43 2023-02-12 03:03:38,946 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f1/32a21e90f61549e28454844e835dfff3 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/32a21e90f61549e28454844e835dfff3 2023-02-12 03:03:38,946 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f1/705c71b4ce3c43c2840ddbe0613bc220 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/705c71b4ce3c43c2840ddbe0613bc220 2023-02-12 03:03:38,960 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/32a21e90f61549e28454844e835dfff3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:38,962 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/705c71b4ce3c43c2840ddbe0613bc220, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:38,962 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f2/93a7621ef89146c0873f8d2a28936f10 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/93a7621ef89146c0873f8d2a28936f10 2023-02-12 03:03:38,963 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f2/e443c0ef818240b68a7c7d284c174f43 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/e443c0ef818240b68a7c7d284c174f43 2023-02-12 03:03:38,967 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f2/15893584e0524cc1b5863d521d766814 2023-02-12 03:03:38,968 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f2/2d459a9a57d9436ab5c254a4e36d15f4 2023-02-12 03:03:38,972 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/e443c0ef818240b68a7c7d284c174f43, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:38,973 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6f7cfee86cd5934e7ea6b364fa87ca90 in 230ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:38,973 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 03:03:38,974 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6f7cfee86cd5934e7ea6b364fa87ca90: 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/705c71b4ce3c43c2840ddbe0613bc220] hfiles 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/705c71b4ce3c43c2840ddbe0613bc220 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/e443c0ef818240b68a7c7d284c174f43] hfiles 2023-02-12 03:03:38,975 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/e443c0ef818240b68a7c7d284c174f43 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,982 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f1/5eb4866397b3423ba81f1d60e2b1588a as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/5eb4866397b3423ba81f1d60e2b1588a 2023-02-12 03:03:38,986 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/93a7621ef89146c0873f8d2a28936f10, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:38,987 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ffd3f927a92f2f2cc70dea0f25c9d54b in 239ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:38,990 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/5eb4866397b3423ba81f1d60e2b1588a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:38,991 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f1/816567aef3c347668f0f7c14a05675e2 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/816567aef3c347668f0f7c14a05675e2 2023-02-12 03:03:38,991 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f2/15893584e0524cc1b5863d521d766814 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/15893584e0524cc1b5863d521d766814 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ffd3f927a92f2f2cc70dea0f25c9d54b: 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/32a21e90f61549e28454844e835dfff3] hfiles 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/32a21e90f61549e28454844e835dfff3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/93a7621ef89146c0873f8d2a28936f10] hfiles 2023-02-12 03:03:38,993 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/93a7621ef89146c0873f8d2a28936f10 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,000 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/15893584e0524cc1b5863d521d766814, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,000 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/816567aef3c347668f0f7c14a05675e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,001 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 96d4ccfdd3c0485a206673996af397ca in 258ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,001 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f2/2d459a9a57d9436ab5c254a4e36d15f4 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/2d459a9a57d9436ab5c254a4e36d15f4 2023-02-12 03:03:39,001 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 96d4ccfdd3c0485a206673996af397ca: 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/5eb4866397b3423ba81f1d60e2b1588a] hfiles 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/5eb4866397b3423ba81f1d60e2b1588a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/15893584e0524cc1b5863d521d766814] hfiles 2023-02-12 03:03:39,002 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/15893584e0524cc1b5863d521d766814 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,012 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f2/c001851a92be4cceab68b4682b5a7358 2023-02-12 03:03:39,017 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/2d459a9a57d9436ab5c254a4e36d15f4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,018 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c7ec9d775b089edec9ee11974e984f1a in 270ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c7ec9d775b089edec9ee11974e984f1a: 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/816567aef3c347668f0f7c14a05675e2] hfiles 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/816567aef3c347668f0f7c14a05675e2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/2d459a9a57d9436ab5c254a4e36d15f4] hfiles 2023-02-12 03:03:39,019 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/2d459a9a57d9436ab5c254a4e36d15f4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,030 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f2/767480b069734f96b85132a036258373 2023-02-12 03:03:39,033 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. completed. 2023-02-12 03:03:39,033 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:39,033 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:39,033 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:39,033 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. started... 2023-02-12 03:03:39,033 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c3089990f54d86a73d8f0d48f8d85b5f: 2023-02-12 03:03:39,034 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,034 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,034 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:39,034 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:39,037 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f1/df674d211227416ab5e1c765d87bcaac as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/df674d211227416ab5e1c765d87bcaac 2023-02-12 03:03:39,045 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f1/0dfe611c3af84455937655fdbdb283e3 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/0dfe611c3af84455937655fdbdb283e3 2023-02-12 03:03:39,051 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. completed. 2023-02-12 03:03:39,051 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:39,051 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:39,055 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/df674d211227416ab5e1c765d87bcaac, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,055 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/0dfe611c3af84455937655fdbdb283e3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. completed. 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. started... 2023-02-12 03:03:39,056 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:39,056 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4afbe115a418795c8e20644f0f074003 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f2/767480b069734f96b85132a036258373 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/767480b069734f96b85132a036258373 2023-02-12 03:03:39,056 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f2/c001851a92be4cceab68b4682b5a7358 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/c001851a92be4cceab68b4682b5a7358 2023-02-12 03:03:39,066 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. completed. 2023-02-12 03:03:39,067 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:39,067 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:39,068 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/767480b069734f96b85132a036258373, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,069 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 92cbb8bf131e9fdead5817905c555cc6 in 324ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 92cbb8bf131e9fdead5817905c555cc6: 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,069 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/c001851a92be4cceab68b4682b5a7358, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/0dfe611c3af84455937655fdbdb283e3] hfiles 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/0dfe611c3af84455937655fdbdb283e3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/767480b069734f96b85132a036258373] hfiles 2023-02-12 03:03:39,069 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/767480b069734f96b85132a036258373 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,070 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b483db50bb8d91e4e8a489f59331c8b7 in 264ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b483db50bb8d91e4e8a489f59331c8b7: 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/df674d211227416ab5e1c765d87bcaac] hfiles 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/df674d211227416ab5e1c765d87bcaac for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/c001851a92be4cceab68b4682b5a7358] hfiles 2023-02-12 03:03:39,070 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/c001851a92be4cceab68b4682b5a7358 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,085 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f1/b96393fb537c4916affcbbb0441b92eb 2023-02-12 03:03:39,088 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. completed. 2023-02-12 03:03:39,089 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:39,089 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:39,089 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:39,089 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,089 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 03:03:39,089 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase6.apache.org,44663,1676171015443' in zk 2023-02-12 03:03:39,090 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. completed. 2023-02-12 03:03:39,091 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:39,091 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:39,091 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. started... 2023-02-12 03:03:39,091 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5fbb4212596791f04f3d0d6132267f5e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:39,091 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:39,091 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,091 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 03:03:39,091 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:39,091 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 03:03:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase6.apache.org,44663,1676171015443': 2023-02-12 03:03:39,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44663,1676171015443' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 03:03:39,117 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f1/722b37a1cfd04d4683fdfb3e9b6a09eb 2023-02-12 03:03:39,134 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f2/e7f5e886fe2e4826b4cc5e7498989c8e 2023-02-12 03:03:39,142 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f1/b96393fb537c4916affcbbb0441b92eb as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/b96393fb537c4916affcbbb0441b92eb 2023-02-12 03:03:39,148 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/b96393fb537c4916affcbbb0441b92eb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,149 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f2/e7f5e886fe2e4826b4cc5e7498989c8e as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/e7f5e886fe2e4826b4cc5e7498989c8e 2023-02-12 03:03:39,154 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/e7f5e886fe2e4826b4cc5e7498989c8e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:39,156 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4afbe115a418795c8e20644f0f074003 in 99ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4afbe115a418795c8e20644f0f074003: 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/b96393fb537c4916affcbbb0441b92eb] hfiles 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/b96393fb537c4916affcbbb0441b92eb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/e7f5e886fe2e4826b4cc5e7498989c8e] hfiles 2023-02-12 03:03:39,156 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/e7f5e886fe2e4826b4cc5e7498989c8e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,161 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f2/864119386f86458abee6d3898d026cdc 2023-02-12 03:03:39,167 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f1/722b37a1cfd04d4683fdfb3e9b6a09eb as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/722b37a1cfd04d4683fdfb3e9b6a09eb 2023-02-12 03:03:39,179 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/722b37a1cfd04d4683fdfb3e9b6a09eb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:39,183 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. completed. 2023-02-12 03:03:39,183 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:39,183 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f2/864119386f86458abee6d3898d026cdc as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/864119386f86458abee6d3898d026cdc 2023-02-12 03:03:39,183 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:39,188 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/864119386f86458abee6d3898d026cdc, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:39,189 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5fbb4212596791f04f3d0d6132267f5e in 98ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5fbb4212596791f04f3d0d6132267f5e: 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/722b37a1cfd04d4683fdfb3e9b6a09eb] hfiles 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/722b37a1cfd04d4683fdfb3e9b6a09eb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/864119386f86458abee6d3898d026cdc] hfiles 2023-02-12 03:03:39,189 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/864119386f86458abee6d3898d026cdc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,200 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. completed. 2023-02-12 03:03:39,200 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:39,200 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:39,393 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:39,395 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 03:03:39,454 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. completed. 2023-02-12 03:03:39,455 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:39,455 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:39,455 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:39,455 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,455 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 03:03:39,455 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase6.apache.org,42971,1676171015485' in zk 2023-02-12 03:03:39,458 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,458 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 03:03:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:39,458 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:39,458 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 03:03:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase6.apache.org,42971,1676171015485': 2023-02-12 03:03:39,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,42971,1676171015485' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 03:03:39,462 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-12 03:03:39,462 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:39,462 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:39,462 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,462 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:03:39,464 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,464 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:39,464 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:39,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:39,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:39,465 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,467 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:39,467 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:39,472 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:39,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:39,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:39,472 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:39,473 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:39,474 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:39,474 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,474 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:39,474 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,474 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:39,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:39,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,533 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-12 03:03:39,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,534 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:39,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676171018278Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676171019473 (+1195 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676171019473Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676171019483 (+10 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676171019493 (+10 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676171019533 (+40 ms) 2023-02-12 03:03:39,535 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:03:39,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2560 sec 2023-02-12 03:03:40,395 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:40,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:03:40,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:03:40,398 INFO [Listener at localhost/40969] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:03:40,402 INFO [Listener at localhost/40969] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:03:40,410 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:03:40,450 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44663] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:40,686 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42971] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:40,782 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:03:40,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:03:40,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 03:03:40,794 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 03:03:40,794 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:40,795 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 03:03:40,795 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 03:03:40,796 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:40,796 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:40,797 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:40,798 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:40,798 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:40,798 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:40,798 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:40,798 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:40,799 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:03:40,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:03:40,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:03:40,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:03:40,800 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:03:40,800 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:40,803 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:03:40,803 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:03:40,803 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:40,807 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. started... 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:40,807 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b7e0f1682e64d68a3b101725f74760c: 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. started... 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. started... 2023-02-12 03:03:40,807 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:40,807 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:40,808 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffd3f927a92f2f2cc70dea0f25c9d54b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:40,808 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6f7cfee86cd5934e7ea6b364fa87ca90 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. started... 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:40,808 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b483db50bb8d91e4e8a489f59331c8b7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:40,808 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:40,808 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:40,808 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:40,809 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. started... 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. started... 2023-02-12 03:03:40,809 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c7ec9d775b089edec9ee11974e984f1a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,808 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. started... 2023-02-12 03:03:40,809 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 96d4ccfdd3c0485a206673996af397ca 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,809 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 92cbb8bf131e9fdead5817905c555cc6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,862 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f1/1f6bd48d36244f26abb6490ca47858c2 2023-02-12 03:03:40,876 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f1/06e1c9bb0ce444e5adcd173d15f458c1 2023-02-12 03:03:40,881 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f1/ba15a9a302894ef8b5e2fb5e542cb97b 2023-02-12 03:03:40,882 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f1/b2fb4484081f40529ebdff83935b9f61 2023-02-12 03:03:40,888 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f1/8f224ce5f3b243ba8cebe1ccd2ee2e98 2023-02-12 03:03:40,896 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f1/ac28da9edc9646aca3f57e9c62d53fce 2023-02-12 03:03:40,927 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f2/634b5ae8db1f42afbfa117bd9c9e9ea6 2023-02-12 03:03:40,931 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f2/55fd09702a134c5ab7d973fa27b8ff55 2023-02-12 03:03:40,936 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f1/1f6bd48d36244f26abb6490ca47858c2 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/1f6bd48d36244f26abb6490ca47858c2 2023-02-12 03:03:40,938 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f2/efb989888da44079ab8653a02900b484 2023-02-12 03:03:40,943 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f1/ba15a9a302894ef8b5e2fb5e542cb97b as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/ba15a9a302894ef8b5e2fb5e542cb97b 2023-02-12 03:03:40,946 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/1f6bd48d36244f26abb6490ca47858c2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,948 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/.tmp/f2/634b5ae8db1f42afbfa117bd9c9e9ea6 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/634b5ae8db1f42afbfa117bd9c9e9ea6 2023-02-12 03:03:40,950 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f1/06e1c9bb0ce444e5adcd173d15f458c1 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/06e1c9bb0ce444e5adcd173d15f458c1 2023-02-12 03:03:40,950 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/ba15a9a302894ef8b5e2fb5e542cb97b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,950 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f2/5f5b453babb0417eb8f1f69c1aef1814 2023-02-12 03:03:40,952 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/.tmp/f2/55fd09702a134c5ab7d973fa27b8ff55 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/55fd09702a134c5ab7d973fa27b8ff55 2023-02-12 03:03:40,957 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/634b5ae8db1f42afbfa117bd9c9e9ea6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,958 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 96d4ccfdd3c0485a206673996af397ca in 149ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:40,958 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 96d4ccfdd3c0485a206673996af397ca: 2023-02-12 03:03:40,958 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:40,958 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f1/ac28da9edc9646aca3f57e9c62d53fce as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/ac28da9edc9646aca3f57e9c62d53fce 2023-02-12 03:03:40,958 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:40,958 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:40,958 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. started... 2023-02-12 03:03:40,959 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4afbe115a418795c8e20644f0f074003 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:40,960 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/06e1c9bb0ce444e5adcd173d15f458c1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,962 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/55fd09702a134c5ab7d973fa27b8ff55, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,962 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/.tmp/f2/efb989888da44079ab8653a02900b484 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/efb989888da44079ab8653a02900b484 2023-02-12 03:03:40,966 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 92cbb8bf131e9fdead5817905c555cc6 in 157ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:40,966 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 92cbb8bf131e9fdead5817905c555cc6: 2023-02-12 03:03:40,966 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:40,966 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:40,966 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:40,966 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. started... 2023-02-12 03:03:40,966 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5fbb4212596791f04f3d0d6132267f5e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:40,969 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/ac28da9edc9646aca3f57e9c62d53fce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,971 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/.tmp/f2/5f5b453babb0417eb8f1f69c1aef1814 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/5f5b453babb0417eb8f1f69c1aef1814 2023-02-12 03:03:40,978 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/5f5b453babb0417eb8f1f69c1aef1814, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,979 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b483db50bb8d91e4e8a489f59331c8b7 in 171ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:40,980 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b483db50bb8d91e4e8a489f59331c8b7: 2023-02-12 03:03:40,980 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:40,982 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:40,982 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:40,982 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. started... 2023-02-12 03:03:40,983 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c3089990f54d86a73d8f0d48f8d85b5f: 2023-02-12 03:03:40,983 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:40,983 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:40,987 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f2/24ae4ba8acee4397b1989e54a8436bfa 2023-02-12 03:03:40,989 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/efb989888da44079ab8653a02900b484, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:40,990 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c7ec9d775b089edec9ee11974e984f1a in 181ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:40,991 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c7ec9d775b089edec9ee11974e984f1a: 2023-02-12 03:03:40,991 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:40,991 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:40,994 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f1/8f224ce5f3b243ba8cebe1ccd2ee2e98 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/8f224ce5f3b243ba8cebe1ccd2ee2e98 2023-02-12 03:03:41,010 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f1/795800082ca247c1959368eba3cbd3e4 2023-02-12 03:03:41,013 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/8f224ce5f3b243ba8cebe1ccd2ee2e98, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:41,013 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f1/555bb5e0435844fcb939ff2050ecef1f 2023-02-12 03:03:41,014 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/.tmp/f2/24ae4ba8acee4397b1989e54a8436bfa as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/24ae4ba8acee4397b1989e54a8436bfa 2023-02-12 03:03:41,022 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/24ae4ba8acee4397b1989e54a8436bfa, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:41,024 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ffd3f927a92f2f2cc70dea0f25c9d54b in 216ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:41,024 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffd3f927a92f2f2cc70dea0f25c9d54b: 2023-02-12 03:03:41,024 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,024 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:41,038 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f2/a4bab0d0416249febe72ce68252ea411 2023-02-12 03:03:41,046 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f1/795800082ca247c1959368eba3cbd3e4 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/795800082ca247c1959368eba3cbd3e4 2023-02-12 03:03:41,048 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f2/3c472b9c062146dab6433f4aca5d3db6 2023-02-12 03:03:41,053 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/795800082ca247c1959368eba3cbd3e4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:41,054 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/.tmp/f2/a4bab0d0416249febe72ce68252ea411 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/a4bab0d0416249febe72ce68252ea411 2023-02-12 03:03:41,056 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f1/555bb5e0435844fcb939ff2050ecef1f as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/555bb5e0435844fcb939ff2050ecef1f 2023-02-12 03:03:41,061 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/a4bab0d0416249febe72ce68252ea411, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:41,062 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/555bb5e0435844fcb939ff2050ecef1f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:41,063 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4afbe115a418795c8e20644f0f074003 in 104ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:41,063 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4afbe115a418795c8e20644f0f074003: 2023-02-12 03:03:41,063 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,063 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:41,063 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/.tmp/f2/3c472b9c062146dab6433f4aca5d3db6 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/3c472b9c062146dab6433f4aca5d3db6 2023-02-12 03:03:41,069 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/3c472b9c062146dab6433f4aca5d3db6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:41,070 INFO [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5fbb4212596791f04f3d0d6132267f5e in 104ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:41,070 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5fbb4212596791f04f3d0d6132267f5e: 2023-02-12 03:03:41,070 DEBUG [rs(jenkins-hbase6.apache.org,42971,1676171015485)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,070 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:41,070 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:41,070 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,070 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:03:41,070 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,42971,1676171015485' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:03:41,072 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,072 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:41,072 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,073 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:41,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,42971,1676171015485' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 03:03:41,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@413619fe[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:41,336 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f2/922db251ffc4430ea03409b8271367c4 2023-02-12 03:03:41,343 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f1/b2fb4484081f40529ebdff83935b9f61 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/b2fb4484081f40529ebdff83935b9f61 2023-02-12 03:03:41,347 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/b2fb4484081f40529ebdff83935b9f61, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:41,348 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/.tmp/f2/922db251ffc4430ea03409b8271367c4 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/922db251ffc4430ea03409b8271367c4 2023-02-12 03:03:41,353 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/922db251ffc4430ea03409b8271367c4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:41,354 INFO [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6f7cfee86cd5934e7ea6b364fa87ca90 in 546ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:41,354 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6f7cfee86cd5934e7ea6b364fa87ca90: 2023-02-12 03:03:41,354 DEBUG [rs(jenkins-hbase6.apache.org,44663,1676171015443)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,355 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:41,355 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:41,355 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,355 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:03:41,355 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44663,1676171015443' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:03:41,356 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,356 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:41,357 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,357 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:41,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44663,1676171015443' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 03:03:41,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@413619fe[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:41,359 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 03:03:41,359 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,361 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,361 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:03:41,362 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,44663,1676171015443' in zk 2023-02-12 03:03:41,362 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,42971,1676171015485' in zk 2023-02-12 03:03:41,362 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,362 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:41,364 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:03:41,364 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,364 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:41,364 DEBUG [member: 'jenkins-hbase6.apache.org,42971,1676171015485' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:03:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:41,365 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,365 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:03:41,365 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:41,365 DEBUG [member: 'jenkins-hbase6.apache.org,44663,1676171015443' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:03:41,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,42971,1676171015485': 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,42971,1676171015485' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,44663,1676171015443': 2023-02-12 03:03:41,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44663,1676171015443' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 03:03:41,372 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 03:03:41,372 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:41,372 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:41,372 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 03:03:41,372 INFO [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:03:41,374 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:41,374 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:41,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,374 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:41,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:41,375 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,375 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,377 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:41,377 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:03:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:41,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:41,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:41,382 DEBUG [(jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:41,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 03:03:41,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:03:41,382 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:03:41,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:41,383 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:03:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:41,384 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:03:41,484 DEBUG [Listener at localhost/40969] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:03:41,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39959] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:03:41,486 INFO [Listener at localhost/40969] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:03:41,486 DEBUG [Listener at localhost/40969] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30b568ac to 127.0.0.1:57462 2023-02-12 03:03:41,486 DEBUG [Listener at localhost/40969] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,487 DEBUG [Listener at localhost/40969] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:03:41,487 DEBUG [Listener at localhost/40969] util.JVMClusterUtil(257): Found active master hash=1896321003, stopped=false 2023-02-12 03:03:41,487 INFO [Listener at localhost/40969] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:41,488 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:41,488 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:41,488 INFO [Listener at localhost/40969] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:03:41,488 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:41,488 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:41,490 DEBUG [Listener at localhost/40969] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52fa2ae9 to 127.0.0.1:57462 2023-02-12 03:03:41,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:41,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:41,490 DEBUG [Listener at localhost/40969] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:41,490 INFO [Listener at localhost/40969] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44663,1676171015443' ***** 2023-02-12 03:03:41,491 INFO [Listener at localhost/40969] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:41,491 INFO [Listener at localhost/40969] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,42971,1676171015485' ***** 2023-02-12 03:03:41,491 INFO [Listener at localhost/40969] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:41,491 INFO [RS:0;jenkins-hbase6:44663] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:41,491 INFO [RS:1;jenkins-hbase6:42971] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:41,491 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:41,491 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:41,491 INFO [RS:1;jenkins-hbase6:42971] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:41,491 INFO [RS:0;jenkins-hbase6:44663] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:41,491 INFO [RS:1;jenkins-hbase6:42971] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:41,492 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:41,492 INFO [RS:0;jenkins-hbase6:44663] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:41,492 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(3304): Received CLOSE for 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 96d4ccfdd3c0485a206673996af397ca, disabling compactions & flushes 2023-02-12 03:03:41,493 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(3304): Received CLOSE for 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:41,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 2b7e0f1682e64d68a3b101725f74760c, disabling compactions & flushes 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for b08ff3815bc4684a504ea95f7fb5b716 2023-02-12 03:03:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:41,493 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(3304): Received CLOSE for ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. after waiting 0 ms 2023-02-12 03:03:41,493 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:41,494 DEBUG [RS:1;jenkins-hbase6:42971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x151048e2 to 127.0.0.1:57462 2023-02-12 03:03:41,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:41,493 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(3304): Received CLOSE for b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:41,494 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(3304): Received CLOSE for c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:41,494 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,494 DEBUG [RS:0;jenkins-hbase6:44663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e8557b to 127.0.0.1:57462 2023-02-12 03:03:41,494 DEBUG [RS:0;jenkins-hbase6:44663] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,494 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-12 03:03:41,494 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1479): Online Regions={2b7e0f1682e64d68a3b101725f74760c=testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c., 6f7cfee86cd5934e7ea6b364fa87ca90=testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90., ffd3f927a92f2f2cc70dea0f25c9d54b=testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b., b483db50bb8d91e4e8a489f59331c8b7=testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7., c3089990f54d86a73d8f0d48f8d85b5f=testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.} 2023-02-12 03:03:41,494 DEBUG [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1505): Waiting on 2b7e0f1682e64d68a3b101725f74760c, 6f7cfee86cd5934e7ea6b364fa87ca90, b483db50bb8d91e4e8a489f59331c8b7, c3089990f54d86a73d8f0d48f8d85b5f, ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:41,494 DEBUG [RS:1;jenkins-hbase6:42971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:41,496 INFO [RS:1;jenkins-hbase6:42971] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:41,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. after waiting 0 ms 2023-02-12 03:03:41,498 INFO [RS:1;jenkins-hbase6:42971] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:41,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:41,498 INFO [RS:1;jenkins-hbase6:42971] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:41,500 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:03:41,504 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-12 03:03:41,504 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1479): Online Regions={96d4ccfdd3c0485a206673996af397ca=testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca., 92cbb8bf131e9fdead5817905c555cc6=testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6., c7ec9d775b089edec9ee11974e984f1a=testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a., 4afbe115a418795c8e20644f0f074003=testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003., 5fbb4212596791f04f3d0d6132267f5e=testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e., 1588230740=hbase:meta,,1.1588230740, b08ff3815bc4684a504ea95f7fb5b716=hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716.} 2023-02-12 03:03:41,505 DEBUG [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1505): Waiting on 1588230740, 4afbe115a418795c8e20644f0f074003, 5fbb4212596791f04f3d0d6132267f5e, 92cbb8bf131e9fdead5817905c555cc6, 96d4ccfdd3c0485a206673996af397ca, b08ff3815bc4684a504ea95f7fb5b716, c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:41,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:41,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:41,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:41,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:41,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:41,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-12 03:03:41,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 96d4ccfdd3c0485a206673996af397ca: Waiting for close lock at 1676171021493Running coprocessor pre-close hooks at 1676171021493Disabling compacts and flushes for region at 1676171021493Disabling writes for close at 1676171021494 (+1 ms)Writing region close event to WAL at 1676171021504 (+10 ms)Running coprocessor post-close hooks at 1676171021509 (+5 ms)Closed at 1676171021510 (+1 ms) 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 92cbb8bf131e9fdead5817905c555cc6, disabling compactions & flushes 2023-02-12 03:03:41,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. after waiting 0 ms 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:41,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:41,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 2b7e0f1682e64d68a3b101725f74760c: Waiting for close lock at 1676171021493Running coprocessor pre-close hooks at 1676171021493Disabling compacts and flushes for region at 1676171021493Disabling writes for close at 1676171021498 (+5 ms)Writing region close event to WAL at 1676171021500 (+2 ms)Running coprocessor post-close hooks at 1676171021511 (+11 ms)Closed at 1676171021512 (+1 ms) 2023-02-12 03:03:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:41,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 6f7cfee86cd5934e7ea6b364fa87ca90, disabling compactions & flushes 2023-02-12 03:03:41,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. after waiting 0 ms 2023-02-12 03:03:41,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/.tmp/info/7d59b8bf763c475eab578718b69b335c 2023-02-12 03:03:41,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:41,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 92cbb8bf131e9fdead5817905c555cc6: Waiting for close lock at 1676171021510Running coprocessor pre-close hooks at 1676171021510Disabling compacts and flushes for region at 1676171021510Disabling writes for close at 1676171021510Writing region close event to WAL at 1676171021520 (+10 ms)Running coprocessor post-close hooks at 1676171021532 (+12 ms)Closed at 1676171021532 2023-02-12 03:03:41,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Waiting for close lock at 1676171021512Running coprocessor pre-close hooks at 1676171021512Disabling compacts and flushes for region at 1676171021512Disabling writes for close at 1676171021515 (+3 ms)Writing region close event to WAL at 1676171021527 (+12 ms)Running coprocessor post-close hooks at 1676171021532 (+5 ms)Closed at 1676171021533 (+1 ms) 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing c7ec9d775b089edec9ee11974e984f1a, disabling compactions & flushes 2023-02-12 03:03:41,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing ffd3f927a92f2f2cc70dea0f25c9d54b, disabling compactions & flushes 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:41,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. after waiting 0 ms 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. after waiting 0 ms 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:41,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Waiting for close lock at 1676171021533Running coprocessor pre-close hooks at 1676171021533Disabling compacts and flushes for region at 1676171021533Disabling writes for close at 1676171021533Writing region close event to WAL at 1676171021548 (+15 ms)Running coprocessor post-close hooks at 1676171021552 (+4 ms)Closed at 1676171021553 (+1 ms) 2023-02-12 03:03:41,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:41,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing b483db50bb8d91e4e8a489f59331c8b7, disabling compactions & flushes 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for c7ec9d775b089edec9ee11974e984f1a: Waiting for close lock at 1676171021533Running coprocessor pre-close hooks at 1676171021533Disabling compacts and flushes for region at 1676171021533Disabling writes for close at 1676171021533Writing region close event to WAL at 1676171021548 (+15 ms)Running coprocessor post-close hooks at 1676171021554 (+6 ms)Closed at 1676171021554 2023-02-12 03:03:41,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. after waiting 0 ms 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 4afbe115a418795c8e20644f0f074003, disabling compactions & flushes 2023-02-12 03:03:41,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. after waiting 0 ms 2023-02-12 03:03:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/.tmp/table/7c60b73b9cc94875b18a086d8a8b8035 2023-02-12 03:03:41,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 4afbe115a418795c8e20644f0f074003: Waiting for close lock at 1676171021555Running coprocessor pre-close hooks at 1676171021555Disabling compacts and flushes for region at 1676171021555Disabling writes for close at 1676171021555Writing region close event to WAL at 1676171021564 (+9 ms)Running coprocessor post-close hooks at 1676171021572 (+8 ms)Closed at 1676171021573 (+1 ms) 2023-02-12 03:03:41,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for b483db50bb8d91e4e8a489f59331c8b7: Waiting for close lock at 1676171021555Running coprocessor pre-close hooks at 1676171021555Disabling compacts and flushes for region at 1676171021555Disabling writes for close at 1676171021555Writing region close event to WAL at 1676171021563 (+8 ms)Running coprocessor post-close hooks at 1676171021573 (+10 ms)Closed at 1676171021574 (+1 ms) 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 5fbb4212596791f04f3d0d6132267f5e, disabling compactions & flushes 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:41,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing c3089990f54d86a73d8f0d48f8d85b5f, disabling compactions & flushes 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. after waiting 0 ms 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. after waiting 0 ms 2023-02-12 03:03:41,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:41,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/.tmp/info/7d59b8bf763c475eab578718b69b335c as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/info/7d59b8bf763c475eab578718b69b335c 2023-02-12 03:03:41,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:41,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:41,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for c3089990f54d86a73d8f0d48f8d85b5f: Waiting for close lock at 1676171021575Running coprocessor pre-close hooks at 1676171021575Disabling compacts and flushes for region at 1676171021575Disabling writes for close at 1676171021575Writing region close event to WAL at 1676171021576 (+1 ms)Running coprocessor post-close hooks at 1676171021581 (+5 ms)Closed at 1676171021581 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:41,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 5fbb4212596791f04f3d0d6132267f5e: Waiting for close lock at 1676171021575Running coprocessor pre-close hooks at 1676171021575Disabling compacts and flushes for region at 1676171021575Disabling writes for close at 1676171021575Writing region close event to WAL at 1676171021577 (+2 ms)Running coprocessor post-close hooks at 1676171021581 (+4 ms)Closed at 1676171021581 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing b08ff3815bc4684a504ea95f7fb5b716, disabling compactions & flushes 2023-02-12 03:03:41,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. after waiting 0 ms 2023-02-12 03:03:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:41,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing b08ff3815bc4684a504ea95f7fb5b716 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:03:41,583 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:41,587 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:41,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/info/7d59b8bf763c475eab578718b69b335c, entries=110, sequenceid=32, filesize=18.7 K 2023-02-12 03:03:41,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/.tmp/table/7c60b73b9cc94875b18a086d8a8b8035 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/table/7c60b73b9cc94875b18a086d8a8b8035 2023-02-12 03:03:41,594 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/table/7c60b73b9cc94875b18a086d8a8b8035, entries=4, sequenceid=32, filesize=4.8 K 2023-02-12 03:03:41,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 93ms, sequenceid=32, compaction requested=false 2023-02-12 03:03:41,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 03:03:41,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/.tmp/info/46c9ab655dc849258c44d9831d7c40df 2023-02-12 03:03:41,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/.tmp/info/46c9ab655dc849258c44d9831d7c40df as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/info/46c9ab655dc849258c44d9831d7c40df 2023-02-12 03:03:41,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-12 03:03:41,608 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:41,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:41,609 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171021505Running coprocessor pre-close hooks at 1676171021505Disabling compacts and flushes for region at 1676171021505Disabling writes for close at 1676171021505Obtaining lock to block concurrent updates at 1676171021505Preparing flush snapshotting stores in 1588230740 at 1676171021505Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676171021506 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676171021506Flushing 1588230740/info: creating writer at 1676171021506Flushing 1588230740/info: appending metadata at 1676171021510 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676171021510Flushing 1588230740/table: creating writer at 1676171021550 (+40 ms)Flushing 1588230740/table: appending metadata at 1676171021554 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676171021554Flushing 1588230740/info: reopening flushed file at 1676171021581 (+27 ms)Flushing 1588230740/table: reopening flushed file at 1676171021590 (+9 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 93ms, sequenceid=32, compaction requested=false at 1676171021598 (+8 ms)Writing region close event to WAL at 1676171021605 (+7 ms)Running coprocessor post-close hooks at 1676171021608 (+3 ms)Closed at 1676171021608 2023-02-12 03:03:41,609 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:41,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/info/46c9ab655dc849258c44d9831d7c40df, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:03:41,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b08ff3815bc4684a504ea95f7fb5b716 in 29ms, sequenceid=6, compaction requested=false 2023-02-12 03:03:41,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 03:03:41,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/data/hbase/namespace/b08ff3815bc4684a504ea95f7fb5b716/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:03:41,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:41,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for b08ff3815bc4684a504ea95f7fb5b716: Waiting for close lock at 1676171021581Running coprocessor pre-close hooks at 1676171021581Disabling compacts and flushes for region at 1676171021581Disabling writes for close at 1676171021581Obtaining lock to block concurrent updates at 1676171021581Preparing flush snapshotting stores in b08ff3815bc4684a504ea95f7fb5b716 at 1676171021581Finished memstore snapshotting hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171021582 (+1 ms)Flushing stores of hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. at 1676171021582Flushing b08ff3815bc4684a504ea95f7fb5b716/info: creating writer at 1676171021582Flushing b08ff3815bc4684a504ea95f7fb5b716/info: appending metadata at 1676171021585 (+3 ms)Flushing b08ff3815bc4684a504ea95f7fb5b716/info: closing flushed file at 1676171021585Flushing b08ff3815bc4684a504ea95f7fb5b716/info: reopening flushed file at 1676171021604 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b08ff3815bc4684a504ea95f7fb5b716 in 29ms, sequenceid=6, compaction requested=false at 1676171021610 (+6 ms)Writing region close event to WAL at 1676171021611 (+1 ms)Running coprocessor post-close hooks at 1676171021614 (+3 ms)Closed at 1676171021614 2023-02-12 03:03:41,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171016217.b08ff3815bc4684a504ea95f7fb5b716. 2023-02-12 03:03:41,694 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44663,1676171015443; all regions closed. 2023-02-12 03:03:41,700 DEBUG [RS:0;jenkins-hbase6:44663] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44663%2C1676171015443:(num 1676171016872) 2023-02-12 03:03:41,700 DEBUG [RS:0;jenkins-hbase6:44663] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:41,700 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:41,700 INFO [RS:0;jenkins-hbase6:44663] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:41,701 INFO [RS:0;jenkins-hbase6:44663] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44663 2023-02-12 03:03:41,704 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,704 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44663,1676171015443 2023-02-12 03:03:41,704 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b6e2b9a rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:41,704 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:41,705 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:41,704 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:41,705 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11ba68f rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:41,705 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,42971,1676171015485; all regions closed. 2023-02-12 03:03:41,706 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44663,1676171015443] 2023-02-12 03:03:41,706 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44663,1676171015443; numProcessing=1 2023-02-12 03:03:41,708 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/WALs/jenkins-hbase6.apache.org,42971,1676171015485/jenkins-hbase6.apache.org%2C42971%2C1676171015485.meta.1676171016144.meta not finished, retry = 0 2023-02-12 03:03:41,709 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44663,1676171015443 already deleted, retry=false 2023-02-12 03:03:41,709 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44663,1676171015443 expired; onlineServers=1 2023-02-12 03:03:41,811 DEBUG [RS:1;jenkins-hbase6:42971] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs 2023-02-12 03:03:41,811 INFO [RS:1;jenkins-hbase6:42971] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C42971%2C1676171015485.meta:.meta(num 1676171016144) 2023-02-12 03:03:41,817 DEBUG [RS:1;jenkins-hbase6:42971] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/oldWALs 2023-02-12 03:03:41,817 INFO [RS:1;jenkins-hbase6:42971] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C42971%2C1676171015485:(num 1676171016596) 2023-02-12 03:03:41,817 DEBUG [RS:1;jenkins-hbase6:42971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,817 INFO [RS:1;jenkins-hbase6:42971] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:41,817 INFO [RS:1;jenkins-hbase6:42971] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:41,817 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:41,818 INFO [RS:1;jenkins-hbase6:42971] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:42971 2023-02-12 03:03:41,824 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:41,824 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,42971,1676171015485 2023-02-12 03:03:41,824 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cad1f7 rejected from java.util.concurrent.ThreadPoolExecutor@5f55516[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:41,825 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,42971,1676171015485] 2023-02-12 03:03:41,825 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,42971,1676171015485; numProcessing=2 2023-02-12 03:03:41,827 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,42971,1676171015485 already deleted, retry=false 2023-02-12 03:03:41,827 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,42971,1676171015485 expired; onlineServers=0 2023-02-12 03:03:41,827 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39959,1676171015360' ***** 2023-02-12 03:03:41,827 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:03:41,828 DEBUG [M:0;jenkins-hbase6:39959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75381513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:41,828 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39959,1676171015360 2023-02-12 03:03:41,828 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39959,1676171015360; all regions closed. 2023-02-12 03:03:41,828 DEBUG [M:0;jenkins-hbase6:39959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:41,828 DEBUG [M:0;jenkins-hbase6:39959] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:03:41,828 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:03:41,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171015725] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171015725,5,FailOnTimeoutGroup] 2023-02-12 03:03:41,828 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171015725] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171015725,5,FailOnTimeoutGroup] 2023-02-12 03:03:41,828 DEBUG [M:0;jenkins-hbase6:39959] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:03:41,830 INFO [M:0;jenkins-hbase6:39959] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:03:41,830 INFO [M:0;jenkins-hbase6:39959] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:03:41,830 INFO [M:0;jenkins-hbase6:39959] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:03:41,830 DEBUG [M:0;jenkins-hbase6:39959] master.HMaster(1502): Stopping service threads 2023-02-12 03:03:41,830 INFO [M:0;jenkins-hbase6:39959] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:03:41,830 ERROR [M:0;jenkins-hbase6:39959] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:03:41,831 INFO [M:0;jenkins-hbase6:39959] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:03:41,831 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:03:41,831 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:41,831 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:41,831 DEBUG [M:0;jenkins-hbase6:39959] zookeeper.ZKUtil(398): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:03:41,831 WARN [M:0;jenkins-hbase6:39959] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:03:41,831 INFO [M:0;jenkins-hbase6:39959] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:03:41,832 INFO [M:0;jenkins-hbase6:39959] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:03:41,832 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:41,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:41,832 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:41,832 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:41,832 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:41,832 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:41,832 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-12 03:03:41,842 INFO [M:0;jenkins-hbase6:39959] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a659288bf793452eabe1e92784b4c234 2023-02-12 03:03:41,848 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a659288bf793452eabe1e92784b4c234 as hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a659288bf793452eabe1e92784b4c234 2023-02-12 03:03:41,853 INFO [M:0;jenkins-hbase6:39959] regionserver.HStore(1080): Added hdfs://localhost:37941/user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a659288bf793452eabe1e92784b4c234, entries=31, sequenceid=218, filesize=9.0 K 2023-02-12 03:03:41,854 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false 2023-02-12 03:03:41,855 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:41,855 DEBUG [M:0;jenkins-hbase6:39959] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171021832Disabling compacts and flushes for region at 1676171021832Disabling writes for close at 1676171021832Obtaining lock to block concurrent updates at 1676171021832Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171021832Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676171021832Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171021833 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171021833Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171021836 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171021836Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171021849 (+13 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=218, compaction requested=false at 1676171021854 (+5 ms)Writing region close event to WAL at 1676171021855 (+1 ms)Closed at 1676171021855 2023-02-12 03:03:41,859 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e7bb57eb-a2c5-dfbe-fe1d-542f154a23b7/MasterData/WALs/jenkins-hbase6.apache.org,39959,1676171015360/jenkins-hbase6.apache.org%2C39959%2C1676171015360.1676171015616 not finished, retry = 0 2023-02-12 03:03:41,960 INFO [M:0;jenkins-hbase6:39959] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:03:41,960 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:41,961 INFO [M:0;jenkins-hbase6:39959] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39959 2023-02-12 03:03:41,965 DEBUG [M:0;jenkins-hbase6:39959] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,39959,1676171015360 already deleted, retry=false 2023-02-12 03:03:41,991 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:41,991 INFO [RS:1;jenkins-hbase6:42971] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,42971,1676171015485; zookeeper connection closed. 2023-02-12 03:03:41,992 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26ef23ba rejected from java.util.concurrent.ThreadPoolExecutor@5f55516[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:41,992 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:42971-0x10154e928d80002, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:41,992 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72025ac4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72025ac4 2023-02-12 03:03:41,992 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e0fbd35 rejected from java.util.concurrent.ThreadPoolExecutor@5f55516[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:42,092 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:42,092 INFO [RS:0;jenkins-hbase6:44663] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44663,1676171015443; zookeeper connection closed. 2023-02-12 03:03:42,092 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79c1a65e rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:42,092 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): regionserver:44663-0x10154e928d80001, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:42,092 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2a747c44] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2a747c44 2023-02-12 03:03:42,092 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@460f3cf0 rejected from java.util.concurrent.ThreadPoolExecutor@3f51a82f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:42,092 INFO [Listener at localhost/40969] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:03:42,192 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:42,192 INFO [M:0;jenkins-hbase6:39959] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39959,1676171015360; zookeeper connection closed. 2023-02-12 03:03:42,192 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14bec71a rejected from java.util.concurrent.ThreadPoolExecutor@10814155[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:42,193 DEBUG [Listener at localhost/40969-EventThread] zookeeper.ZKWatcher(600): master:39959-0x10154e928d80000, quorum=127.0.0.1:57462, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:42,193 ERROR [Listener at localhost/40969-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f8edb6 rejected from java.util.concurrent.ThreadPoolExecutor@10814155[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:42,293 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop-5184207232715677590.jar 2023-02-12 03:03:42,298 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676171018259 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:42,298 DEBUG [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:42,299 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(239): region to add: c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=2b7e0f1682e64d68a3b101725f74760c as 2b7e0f1682e64d68a3b101725f74760c in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=96d4ccfdd3c0485a206673996af397ca as 96d4ccfdd3c0485a206673996af397ca in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=92cbb8bf131e9fdead5817905c555cc6 as 92cbb8bf131e9fdead5817905c555cc6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=4afbe115a418795c8e20644f0f074003 as 4afbe115a418795c8e20644f0f074003 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=ffd3f927a92f2f2cc70dea0f25c9d54b as ffd3f927a92f2f2cc70dea0f25c9d54b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=6f7cfee86cd5934e7ea6b364fa87ca90 as 6f7cfee86cd5934e7ea6b364fa87ca90 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=c7ec9d775b089edec9ee11974e984f1a as c7ec9d775b089edec9ee11974e984f1a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,300 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=5fbb4212596791f04f3d0d6132267f5e as 5fbb4212596791f04f3d0d6132267f5e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,301 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=b483db50bb8d91e4e8a489f59331c8b7 as b483db50bb8d91e4e8a489f59331c8b7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,301 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(585): clone region=c3089990f54d86a73d8f0d48f8d85b5f as c3089990f54d86a73d8f0d48f8d85b5f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 03:03:42,302 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b7e0f1682e64d68a3b101725f74760c, NAME => 'testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,302 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 92cbb8bf131e9fdead5817905c555cc6, NAME => 'testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,302 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 96d4ccfdd3c0485a206673996af397ca, NAME => 'testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,303 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 4afbe115a418795c8e20644f0f074003, NAME => 'testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,303 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ffd3f927a92f2f2cc70dea0f25c9d54b, NAME => 'testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,305 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6f7cfee86cd5934e7ea6b364fa87ca90, NAME => 'testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,305 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c7ec9d775b089edec9ee11974e984f1a, NAME => 'testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,306 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 5fbb4212596791f04f3d0d6132267f5e, NAME => 'testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,343 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,343 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0dfe611c3af84455937655fdbdb283e3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,346 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,347 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 32a21e90f61549e28454844e835dfff3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,347 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 767480b069734f96b85132a036258373 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2b7e0f1682e64d68a3b101725f74760c, disabling compactions & flushes 2023-02-12 03:03:42,350 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. after waiting 0 ms 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:42,350 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:42,350 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2b7e0f1682e64d68a3b101725f74760c: Waiting for close lock at 1676171022350Disabling compacts and flushes for region at 1676171022350Disabling writes for close at 1676171022350Writing region close event to WAL at 1676171022350Closed at 1676171022350 2023-02-12 03:03:42,351 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b483db50bb8d91e4e8a489f59331c8b7, NAME => 'testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,351 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,351 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 722b37a1cfd04d4683fdfb3e9b6a09eb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,353 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 93a7621ef89146c0873f8d2a28936f10 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,353 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 92cbb8bf131e9fdead5817905c555cc6, disabling compactions & flushes 2023-02-12 03:03:42,353 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:42,353 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:42,353 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. after waiting 0 ms 2023-02-12 03:03:42,353 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:42,353 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:42,353 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 92cbb8bf131e9fdead5817905c555cc6: Waiting for close lock at 1676171022353Disabling compacts and flushes for region at 1676171022353Disabling writes for close at 1676171022353Writing region close event to WAL at 1676171022353Closed at 1676171022353 2023-02-12 03:03:42,354 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,354 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c3089990f54d86a73d8f0d48f8d85b5f, NAME => 'testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,354 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b96393fb537c4916affcbbb0441b92eb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,354 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 864119386f86458abee6d3898d026cdc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,355 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ffd3f927a92f2f2cc70dea0f25c9d54b, disabling compactions & flushes 2023-02-12 03:03:42,355 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:42,355 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:42,356 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. after waiting 0 ms 2023-02-12 03:03:42,356 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:42,356 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:42,356 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Waiting for close lock at 1676171022355Disabling compacts and flushes for region at 1676171022355Disabling writes for close at 1676171022356 (+1 ms)Writing region close event to WAL at 1676171022356Closed at 1676171022356 2023-02-12 03:03:42,357 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e7f5e886fe2e4826b4cc5e7498989c8e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,358 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 5fbb4212596791f04f3d0d6132267f5e, disabling compactions & flushes 2023-02-12 03:03:42,358 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:42,358 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:42,358 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. after waiting 0 ms 2023-02-12 03:03:42,358 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:42,358 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:42,358 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 5fbb4212596791f04f3d0d6132267f5e: Waiting for close lock at 1676171022358Disabling compacts and flushes for region at 1676171022358Disabling writes for close at 1676171022358Writing region close event to WAL at 1676171022358Closed at 1676171022358 2023-02-12 03:03:42,363 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,363 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink df674d211227416ab5e1c765d87bcaac from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,366 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 4afbe115a418795c8e20644f0f074003, disabling compactions & flushes 2023-02-12 03:03:42,366 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:42,366 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:42,367 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. after waiting 0 ms 2023-02-12 03:03:42,367 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:42,367 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:42,367 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 4afbe115a418795c8e20644f0f074003: Waiting for close lock at 1676171022366Disabling compacts and flushes for region at 1676171022366Disabling writes for close at 1676171022367 (+1 ms)Writing region close event to WAL at 1676171022367Closed at 1676171022367 2023-02-12 03:03:42,371 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c001851a92be4cceab68b4682b5a7358 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b483db50bb8d91e4e8a489f59331c8b7, disabling compactions & flushes 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c3089990f54d86a73d8f0d48f8d85b5f, disabling compactions & flushes 2023-02-12 03:03:42,374 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:42,374 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. after waiting 0 ms 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:42,374 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:42,374 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. after waiting 0 ms 2023-02-12 03:03:42,375 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b483db50bb8d91e4e8a489f59331c8b7: Waiting for close lock at 1676171022374Disabling compacts and flushes for region at 1676171022374Disabling writes for close at 1676171022374Writing region close event to WAL at 1676171022374Closed at 1676171022374 2023-02-12 03:03:42,375 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:42,375 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:42,375 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c3089990f54d86a73d8f0d48f8d85b5f: Waiting for close lock at 1676171022374Disabling compacts and flushes for region at 1676171022374Disabling writes for close at 1676171022375 (+1 ms)Writing region close event to WAL at 1676171022375Closed at 1676171022375 2023-02-12 03:03:42,749 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,749 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5eb4866397b3423ba81f1d60e2b1588a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,751 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15893584e0524cc1b5863d521d766814 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,751 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,751 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 816567aef3c347668f0f7c14a05675e2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,752 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:42,752 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 705c71b4ce3c43c2840ddbe0613bc220 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,756 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2d459a9a57d9436ab5c254a4e36d15f4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,756 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 96d4ccfdd3c0485a206673996af397ca, disabling compactions & flushes 2023-02-12 03:03:42,756 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:42,756 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:42,756 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. after waiting 0 ms 2023-02-12 03:03:42,756 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:42,756 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:42,756 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 96d4ccfdd3c0485a206673996af397ca: Waiting for close lock at 1676171022756Disabling compacts and flushes for region at 1676171022756Disabling writes for close at 1676171022756Writing region close event to WAL at 1676171022756Closed at 1676171022756 2023-02-12 03:03:42,758 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c7ec9d775b089edec9ee11974e984f1a, disabling compactions & flushes 2023-02-12 03:03:42,758 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:42,758 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:42,758 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. after waiting 0 ms 2023-02-12 03:03:42,758 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:42,758 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:42,758 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c7ec9d775b089edec9ee11974e984f1a: Waiting for close lock at 1676171022758Disabling compacts and flushes for region at 1676171022758Disabling writes for close at 1676171022758Writing region close event to WAL at 1676171022758Closed at 1676171022758 2023-02-12 03:03:42,758 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e443c0ef818240b68a7c7d284c174f43 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 03:03:42,760 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6f7cfee86cd5934e7ea6b364fa87ca90, disabling compactions & flushes 2023-02-12 03:03:42,760 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:42,760 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:42,761 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. after waiting 0 ms 2023-02-12 03:03:42,761 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:42,761 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:42,761 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Waiting for close lock at 1676171022760Disabling compacts and flushes for region at 1676171022760Disabling writes for close at 1676171022761 (+1 ms)Writing region close event to WAL at 1676171022761Closed at 1676171022761 2023-02-12 03:03:42,761 INFO [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676171018259 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:42,761 DEBUG [Listener at localhost/40969] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,761 DEBUG [Listener at localhost/40969] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad 2023-02-12 03:03:42,762 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-data/ 2023-02-12 03:03:42,762 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----default/ 2023-02-12 03:03:42,763 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 03:03:42,763 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------2b7e0f1682e64d68a3b101725f74760c/ 2023-02-12 03:03:42,763 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,764 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------4afbe115a418795c8e20644f0f074003/ 2023-02-12 03:03:42,764 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,764 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,764 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=4afbe115a418795c8e20644f0f074003-b96393fb537c4916affcbbb0441b92eb 2023-02-12 03:03:42,765 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,765 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=4afbe115a418795c8e20644f0f074003-e7f5e886fe2e4826b4cc5e7498989c8e 2023-02-12 03:03:42,765 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------5fbb4212596791f04f3d0d6132267f5e/ 2023-02-12 03:03:42,765 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,765 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,766 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=5fbb4212596791f04f3d0d6132267f5e-722b37a1cfd04d4683fdfb3e9b6a09eb 2023-02-12 03:03:42,766 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,767 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=5fbb4212596791f04f3d0d6132267f5e-864119386f86458abee6d3898d026cdc 2023-02-12 03:03:42,767 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------6f7cfee86cd5934e7ea6b364fa87ca90/ 2023-02-12 03:03:42,767 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,767 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,768 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=6f7cfee86cd5934e7ea6b364fa87ca90-705c71b4ce3c43c2840ddbe0613bc220 2023-02-12 03:03:42,768 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,768 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=6f7cfee86cd5934e7ea6b364fa87ca90-e443c0ef818240b68a7c7d284c174f43 2023-02-12 03:03:42,768 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------92cbb8bf131e9fdead5817905c555cc6/ 2023-02-12 03:03:42,769 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,769 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,769 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=92cbb8bf131e9fdead5817905c555cc6-0dfe611c3af84455937655fdbdb283e3 2023-02-12 03:03:42,769 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,769 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=92cbb8bf131e9fdead5817905c555cc6-767480b069734f96b85132a036258373 2023-02-12 03:03:42,770 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------96d4ccfdd3c0485a206673996af397ca/ 2023-02-12 03:03:42,770 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,770 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,771 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=96d4ccfdd3c0485a206673996af397ca-5eb4866397b3423ba81f1d60e2b1588a 2023-02-12 03:03:42,771 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,771 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=96d4ccfdd3c0485a206673996af397ca-15893584e0524cc1b5863d521d766814 2023-02-12 03:03:42,771 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------b483db50bb8d91e4e8a489f59331c8b7/ 2023-02-12 03:03:42,772 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,772 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,772 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=b483db50bb8d91e4e8a489f59331c8b7-df674d211227416ab5e1c765d87bcaac 2023-02-12 03:03:42,772 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,773 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=b483db50bb8d91e4e8a489f59331c8b7-c001851a92be4cceab68b4682b5a7358 2023-02-12 03:03:42,773 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------c3089990f54d86a73d8f0d48f8d85b5f/ 2023-02-12 03:03:42,773 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,773 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------c7ec9d775b089edec9ee11974e984f1a/ 2023-02-12 03:03:42,774 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,774 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,774 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=c7ec9d775b089edec9ee11974e984f1a-816567aef3c347668f0f7c14a05675e2 2023-02-12 03:03:42,774 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,775 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=c7ec9d775b089edec9ee11974e984f1a-2d459a9a57d9436ab5c254a4e36d15f4 2023-02-12 03:03:42,775 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |----------ffd3f927a92f2f2cc70dea0f25c9d54b/ 2023-02-12 03:03:42,775 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:42,775 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:42,776 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=ffd3f927a92f2f2cc70dea0f25c9d54b-32a21e90f61549e28454844e835dfff3 2023-02-12 03:03:42,776 DEBUG [Listener at localhost/40969] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:42,776 DEBUG [Listener at localhost/40969] util.CommonFSUtils(702): |----------------testWithMapReduce=ffd3f927a92f2f2cc70dea0f25c9d54b-93a7621ef89146c0873f8d2a28936f10 2023-02-12 03:03:42,776 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,777 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,777 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,777 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,778 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,778 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,778 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,849 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop-8966711560768059059.jar 2023-02-12 03:03:42,850 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,850 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,850 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,851 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,851 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,852 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,852 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 03:03:42,853 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 03:03:42,853 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 03:03:42,853 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 03:03:42,854 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 03:03:42,854 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 03:03:42,854 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 03:03:42,855 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 03:03:42,855 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 03:03:42,856 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 03:03:42,856 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:03:42,856 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:42,857 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:42,857 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:03:42,857 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:03:42,928 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop-4736078951794519154.jar 2023-02-12 03:03:42,928 DEBUG [Listener at localhost/40969] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:03:42,934 WARN [Listener at localhost/40969] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 03:03:42,966 INFO [Listener at localhost/40969] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 03:03:43,072 WARN [Listener at localhost/40969] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/mapreduce.cluster.local.dir/1676171023038/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 03:03:43,072 WARN [Listener at localhost/40969] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/mapreduce.cluster.local.dir/1676171023038/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 03:03:43,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,108 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,110 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,112 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:43,114 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f1 2023-02-12 03:03:43,114 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b7e0f1682e64d68a3b101725f74760c columnFamilyName f1 2023-02-12 03:03:43,115 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(310): Store=2b7e0f1682e64d68a3b101725f74760c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,115 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b7e0f1682e64d68a3b101725f74760c 2023-02-12 03:03:43,116 DEBUG [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/2b7e0f1682e64d68a3b101725f74760c/f2 2023-02-12 03:03:43,117 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b7e0f1682e64d68a3b101725f74760c columnFamilyName f2 2023-02-12 03:03:43,117 INFO [StoreOpener-2b7e0f1682e64d68a3b101725f74760c-1] regionserver.HStore(310): Store=2b7e0f1682e64d68a3b101725f74760c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,117 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,118 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2b7e0f1682e64d68a3b101725f74760c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69525878, jitterRate=0.0360163152217865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2b7e0f1682e64d68a3b101725f74760c: Writing region info on filesystem at 1676171023110Initializing all the Stores at 1676171023112 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023112Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023112Region opened successfully at 1676171023118 (+6 ms) 2023-02-12 03:03:43,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2b7e0f1682e64d68a3b101725f74760c, disabling compactions & flushes 2023-02-12 03:03:43,137 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:43,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:43,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. after waiting 0 ms 2023-02-12 03:03:43,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:43,137 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676171016876.2b7e0f1682e64d68a3b101725f74760c. 2023-02-12 03:03:43,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2b7e0f1682e64d68a3b101725f74760c: Waiting for close lock at 1676171023136Disabling compacts and flushes for region at 1676171023136Disabling writes for close at 1676171023137 (+1 ms)Writing region close event to WAL at 1676171023137Closed at 1676171023137 2023-02-12 03:03:43,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,141 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,142 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,143 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:43,144 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1 2023-02-12 03:03:43,145 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b483db50bb8d91e4e8a489f59331c8b7 columnFamilyName f1 2023-02-12 03:03:43,150 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f1/testWithMapReduce=b483db50bb8d91e4e8a489f59331c8b7-df674d211227416ab5e1c765d87bcaac 2023-02-12 03:03:43,150 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(310): Store=b483db50bb8d91e4e8a489f59331c8b7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,150 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b483db50bb8d91e4e8a489f59331c8b7 2023-02-12 03:03:43,151 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2 2023-02-12 03:03:43,151 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b483db50bb8d91e4e8a489f59331c8b7 columnFamilyName f2 2023-02-12 03:03:43,158 DEBUG [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/b483db50bb8d91e4e8a489f59331c8b7/f2/testWithMapReduce=b483db50bb8d91e4e8a489f59331c8b7-c001851a92be4cceab68b4682b5a7358 2023-02-12 03:03:43,158 INFO [StoreOpener-b483db50bb8d91e4e8a489f59331c8b7-1] regionserver.HStore(310): Store=b483db50bb8d91e4e8a489f59331c8b7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b483db50bb8d91e4e8a489f59331c8b7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72739724, jitterRate=0.08390635251998901}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b483db50bb8d91e4e8a489f59331c8b7: Writing region info on filesystem at 1676171023142Initializing all the Stores at 1676171023143 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023143Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023143Region opened successfully at 1676171023158 (+15 ms) 2023-02-12 03:03:43,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b483db50bb8d91e4e8a489f59331c8b7, disabling compactions & flushes 2023-02-12 03:03:43,194 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:43,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:43,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. after waiting 0 ms 2023-02-12 03:03:43,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:43,195 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676171016876.b483db50bb8d91e4e8a489f59331c8b7. 2023-02-12 03:03:43,195 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b483db50bb8d91e4e8a489f59331c8b7: Waiting for close lock at 1676171023193Disabling compacts and flushes for region at 1676171023193Disabling writes for close at 1676171023194 (+1 ms)Writing region close event to WAL at 1676171023195 (+1 ms)Closed at 1676171023195 2023-02-12 03:03:43,198 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,198 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,199 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,201 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:43,202 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1 2023-02-12 03:03:43,202 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92cbb8bf131e9fdead5817905c555cc6 columnFamilyName f1 2023-02-12 03:03:43,207 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f1/testWithMapReduce=92cbb8bf131e9fdead5817905c555cc6-0dfe611c3af84455937655fdbdb283e3 2023-02-12 03:03:43,207 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(310): Store=92cbb8bf131e9fdead5817905c555cc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,207 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92cbb8bf131e9fdead5817905c555cc6 2023-02-12 03:03:43,208 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2 2023-02-12 03:03:43,208 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92cbb8bf131e9fdead5817905c555cc6 columnFamilyName f2 2023-02-12 03:03:43,213 DEBUG [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/92cbb8bf131e9fdead5817905c555cc6/f2/testWithMapReduce=92cbb8bf131e9fdead5817905c555cc6-767480b069734f96b85132a036258373 2023-02-12 03:03:43,213 INFO [StoreOpener-92cbb8bf131e9fdead5817905c555cc6-1] regionserver.HStore(310): Store=92cbb8bf131e9fdead5817905c555cc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,213 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 92cbb8bf131e9fdead5817905c555cc6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73870388, jitterRate=0.10075455904006958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,214 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 92cbb8bf131e9fdead5817905c555cc6: Writing region info on filesystem at 1676171023199Initializing all the Stores at 1676171023200 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023200Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023200Region opened successfully at 1676171023214 (+14 ms) 2023-02-12 03:03:43,247 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 92cbb8bf131e9fdead5817905c555cc6, disabling compactions & flushes 2023-02-12 03:03:43,248 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:43,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:43,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. after waiting 0 ms 2023-02-12 03:03:43,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:43,249 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676171016876.92cbb8bf131e9fdead5817905c555cc6. 2023-02-12 03:03:43,249 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 92cbb8bf131e9fdead5817905c555cc6: Waiting for close lock at 1676171023247Disabling compacts and flushes for region at 1676171023247Disabling writes for close at 1676171023248 (+1 ms)Writing region close event to WAL at 1676171023248Closed at 1676171023249 (+1 ms) 2023-02-12 03:03:43,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,252 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,253 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,255 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:43,256 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:03:43,257 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1 2023-02-12 03:03:43,257 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4afbe115a418795c8e20644f0f074003 columnFamilyName f1 2023-02-12 03:03:43,267 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f1/testWithMapReduce=4afbe115a418795c8e20644f0f074003-b96393fb537c4916affcbbb0441b92eb 2023-02-12 03:03:43,267 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(310): Store=4afbe115a418795c8e20644f0f074003/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,267 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4afbe115a418795c8e20644f0f074003 2023-02-12 03:03:43,268 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2 2023-02-12 03:03:43,269 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4afbe115a418795c8e20644f0f074003 columnFamilyName f2 2023-02-12 03:03:43,278 DEBUG [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/4afbe115a418795c8e20644f0f074003/f2/testWithMapReduce=4afbe115a418795c8e20644f0f074003-e7f5e886fe2e4826b4cc5e7498989c8e 2023-02-12 03:03:43,278 INFO [StoreOpener-4afbe115a418795c8e20644f0f074003-1] regionserver.HStore(310): Store=4afbe115a418795c8e20644f0f074003/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,279 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4afbe115a418795c8e20644f0f074003; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59420275, jitterRate=-0.11456890404224396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4afbe115a418795c8e20644f0f074003: Writing region info on filesystem at 1676171023253Initializing all the Stores at 1676171023254 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023254Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023255 (+1 ms)Region opened successfully at 1676171023279 (+24 ms) 2023-02-12 03:03:43,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4afbe115a418795c8e20644f0f074003, disabling compactions & flushes 2023-02-12 03:03:43,332 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:43,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:43,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. after waiting 0 ms 2023-02-12 03:03:43,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:43,336 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676171016876.4afbe115a418795c8e20644f0f074003. 2023-02-12 03:03:43,336 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4afbe115a418795c8e20644f0f074003: Waiting for close lock at 1676171023331Disabling compacts and flushes for region at 1676171023331Disabling writes for close at 1676171023332 (+1 ms)Writing region close event to WAL at 1676171023336 (+4 ms)Closed at 1676171023336 2023-02-12 03:03:43,340 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,340 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,342 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,344 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:43,345 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1 2023-02-12 03:03:43,346 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbb4212596791f04f3d0d6132267f5e columnFamilyName f1 2023-02-12 03:03:43,351 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f1/testWithMapReduce=5fbb4212596791f04f3d0d6132267f5e-722b37a1cfd04d4683fdfb3e9b6a09eb 2023-02-12 03:03:43,351 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(310): Store=5fbb4212596791f04f3d0d6132267f5e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,351 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5fbb4212596791f04f3d0d6132267f5e 2023-02-12 03:03:43,352 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2 2023-02-12 03:03:43,352 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5fbb4212596791f04f3d0d6132267f5e columnFamilyName f2 2023-02-12 03:03:43,357 DEBUG [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/5fbb4212596791f04f3d0d6132267f5e/f2/testWithMapReduce=5fbb4212596791f04f3d0d6132267f5e-864119386f86458abee6d3898d026cdc 2023-02-12 03:03:43,357 INFO [StoreOpener-5fbb4212596791f04f3d0d6132267f5e-1] regionserver.HStore(310): Store=5fbb4212596791f04f3d0d6132267f5e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,357 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,358 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5fbb4212596791f04f3d0d6132267f5e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65844119, jitterRate=-0.018846169114112854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,358 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5fbb4212596791f04f3d0d6132267f5e: Writing region info on filesystem at 1676171023342Initializing all the Stores at 1676171023343 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023343Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023344 (+1 ms)Region opened successfully at 1676171023358 (+14 ms) 2023-02-12 03:03:43,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5fbb4212596791f04f3d0d6132267f5e, disabling compactions & flushes 2023-02-12 03:03:43,387 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:43,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:43,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. after waiting 0 ms 2023-02-12 03:03:43,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:43,389 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676171016876.5fbb4212596791f04f3d0d6132267f5e. 2023-02-12 03:03:43,389 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5fbb4212596791f04f3d0d6132267f5e: Waiting for close lock at 1676171023387Disabling compacts and flushes for region at 1676171023387Disabling writes for close at 1676171023387Writing region close event to WAL at 1676171023389 (+2 ms)Closed at 1676171023389 2023-02-12 03:03:43,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,392 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,394 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,396 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:43,397 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1 2023-02-12 03:03:43,397 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffd3f927a92f2f2cc70dea0f25c9d54b columnFamilyName f1 2023-02-12 03:03:43,402 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f1/testWithMapReduce=ffd3f927a92f2f2cc70dea0f25c9d54b-32a21e90f61549e28454844e835dfff3 2023-02-12 03:03:43,403 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(310): Store=ffd3f927a92f2f2cc70dea0f25c9d54b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,403 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ffd3f927a92f2f2cc70dea0f25c9d54b 2023-02-12 03:03:43,403 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2 2023-02-12 03:03:43,404 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffd3f927a92f2f2cc70dea0f25c9d54b columnFamilyName f2 2023-02-12 03:03:43,409 DEBUG [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/ffd3f927a92f2f2cc70dea0f25c9d54b/f2/testWithMapReduce=ffd3f927a92f2f2cc70dea0f25c9d54b-93a7621ef89146c0873f8d2a28936f10 2023-02-12 03:03:43,409 INFO [StoreOpener-ffd3f927a92f2f2cc70dea0f25c9d54b-1] regionserver.HStore(310): Store=ffd3f927a92f2f2cc70dea0f25c9d54b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,409 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ffd3f927a92f2f2cc70dea0f25c9d54b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68452783, jitterRate=0.02002595365047455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Writing region info on filesystem at 1676171023394Initializing all the Stores at 1676171023395 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023395Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023395Region opened successfully at 1676171023409 (+14 ms) 2023-02-12 03:03:43,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ffd3f927a92f2f2cc70dea0f25c9d54b, disabling compactions & flushes 2023-02-12 03:03:43,441 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:43,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:43,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. after waiting 0 ms 2023-02-12 03:03:43,441 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:43,442 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676171016876.ffd3f927a92f2f2cc70dea0f25c9d54b. 2023-02-12 03:03:43,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ffd3f927a92f2f2cc70dea0f25c9d54b: Waiting for close lock at 1676171023441Disabling compacts and flushes for region at 1676171023441Disabling writes for close at 1676171023441Writing region close event to WAL at 1676171023442 (+1 ms)Closed at 1676171023442 2023-02-12 03:03:43,445 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,445 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,446 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,448 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:43,449 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1 2023-02-12 03:03:43,450 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96d4ccfdd3c0485a206673996af397ca columnFamilyName f1 2023-02-12 03:03:43,455 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f1/testWithMapReduce=96d4ccfdd3c0485a206673996af397ca-5eb4866397b3423ba81f1d60e2b1588a 2023-02-12 03:03:43,455 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(310): Store=96d4ccfdd3c0485a206673996af397ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,455 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96d4ccfdd3c0485a206673996af397ca 2023-02-12 03:03:43,456 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2 2023-02-12 03:03:43,456 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96d4ccfdd3c0485a206673996af397ca columnFamilyName f2 2023-02-12 03:03:43,461 DEBUG [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/96d4ccfdd3c0485a206673996af397ca/f2/testWithMapReduce=96d4ccfdd3c0485a206673996af397ca-15893584e0524cc1b5863d521d766814 2023-02-12 03:03:43,461 INFO [StoreOpener-96d4ccfdd3c0485a206673996af397ca-1] regionserver.HStore(310): Store=96d4ccfdd3c0485a206673996af397ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,461 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,462 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 96d4ccfdd3c0485a206673996af397ca; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72072409, jitterRate=0.07396258413791656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,462 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 96d4ccfdd3c0485a206673996af397ca: Writing region info on filesystem at 1676171023447Initializing all the Stores at 1676171023447Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023448 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023448Region opened successfully at 1676171023462 (+14 ms) 2023-02-12 03:03:43,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 96d4ccfdd3c0485a206673996af397ca, disabling compactions & flushes 2023-02-12 03:03:43,496 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:43,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:43,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. after waiting 0 ms 2023-02-12 03:03:43,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:43,497 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676171016876.96d4ccfdd3c0485a206673996af397ca. 2023-02-12 03:03:43,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 96d4ccfdd3c0485a206673996af397ca: Waiting for close lock at 1676171023496Disabling compacts and flushes for region at 1676171023496Disabling writes for close at 1676171023496Writing region close event to WAL at 1676171023497 (+1 ms)Closed at 1676171023497 2023-02-12 03:03:43,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,501 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,502 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,504 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:43,506 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f1 2023-02-12 03:03:43,506 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3089990f54d86a73d8f0d48f8d85b5f columnFamilyName f1 2023-02-12 03:03:43,507 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(310): Store=c3089990f54d86a73d8f0d48f8d85b5f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,507 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c3089990f54d86a73d8f0d48f8d85b5f 2023-02-12 03:03:43,508 DEBUG [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c3089990f54d86a73d8f0d48f8d85b5f/f2 2023-02-12 03:03:43,508 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3089990f54d86a73d8f0d48f8d85b5f columnFamilyName f2 2023-02-12 03:03:43,509 INFO [StoreOpener-c3089990f54d86a73d8f0d48f8d85b5f-1] regionserver.HStore(310): Store=c3089990f54d86a73d8f0d48f8d85b5f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,509 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c3089990f54d86a73d8f0d48f8d85b5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59849577, jitterRate=-0.10817180573940277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,509 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c3089990f54d86a73d8f0d48f8d85b5f: Writing region info on filesystem at 1676171023502Initializing all the Stores at 1676171023503 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023503Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023504 (+1 ms)Region opened successfully at 1676171023509 (+5 ms) 2023-02-12 03:03:43,536 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c3089990f54d86a73d8f0d48f8d85b5f, disabling compactions & flushes 2023-02-12 03:03:43,536 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:43,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:43,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. after waiting 0 ms 2023-02-12 03:03:43,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:43,537 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171016876.c3089990f54d86a73d8f0d48f8d85b5f. 2023-02-12 03:03:43,537 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c3089990f54d86a73d8f0d48f8d85b5f: Waiting for close lock at 1676171023536Disabling compacts and flushes for region at 1676171023536Disabling writes for close at 1676171023537 (+1 ms)Writing region close event to WAL at 1676171023537Closed at 1676171023537 2023-02-12 03:03:43,540 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,540 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,542 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,544 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:43,545 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1 2023-02-12 03:03:43,546 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f7cfee86cd5934e7ea6b364fa87ca90 columnFamilyName f1 2023-02-12 03:03:43,551 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f1/testWithMapReduce=6f7cfee86cd5934e7ea6b364fa87ca90-705c71b4ce3c43c2840ddbe0613bc220 2023-02-12 03:03:43,551 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(310): Store=6f7cfee86cd5934e7ea6b364fa87ca90/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,552 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6f7cfee86cd5934e7ea6b364fa87ca90 2023-02-12 03:03:43,552 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2 2023-02-12 03:03:43,553 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f7cfee86cd5934e7ea6b364fa87ca90 columnFamilyName f2 2023-02-12 03:03:43,557 DEBUG [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/6f7cfee86cd5934e7ea6b364fa87ca90/f2/testWithMapReduce=6f7cfee86cd5934e7ea6b364fa87ca90-e443c0ef818240b68a7c7d284c174f43 2023-02-12 03:03:43,557 INFO [StoreOpener-6f7cfee86cd5934e7ea6b364fa87ca90-1] regionserver.HStore(310): Store=6f7cfee86cd5934e7ea6b364fa87ca90/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,557 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6f7cfee86cd5934e7ea6b364fa87ca90; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59448382, jitterRate=-0.11415007710456848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Writing region info on filesystem at 1676171023542Initializing all the Stores at 1676171023543 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023543Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023543Region opened successfully at 1676171023557 (+14 ms) 2023-02-12 03:03:43,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6f7cfee86cd5934e7ea6b364fa87ca90, disabling compactions & flushes 2023-02-12 03:03:43,586 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:43,586 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:43,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. after waiting 0 ms 2023-02-12 03:03:43,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:43,587 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676171016876.6f7cfee86cd5934e7ea6b364fa87ca90. 2023-02-12 03:03:43,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6f7cfee86cd5934e7ea6b364fa87ca90: Waiting for close lock at 1676171023586Disabling compacts and flushes for region at 1676171023586Disabling writes for close at 1676171023587 (+1 ms)Writing region close event to WAL at 1676171023587Closed at 1676171023587 2023-02-12 03:03:43,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:43,590 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:43,592 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:43,595 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:43,596 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1 2023-02-12 03:03:43,596 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7ec9d775b089edec9ee11974e984f1a columnFamilyName f1 2023-02-12 03:03:43,601 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f1/testWithMapReduce=c7ec9d775b089edec9ee11974e984f1a-816567aef3c347668f0f7c14a05675e2 2023-02-12 03:03:43,601 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(310): Store=c7ec9d775b089edec9ee11974e984f1a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,601 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7ec9d775b089edec9ee11974e984f1a 2023-02-12 03:03:43,602 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2 2023-02-12 03:03:43,602 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7ec9d775b089edec9ee11974e984f1a columnFamilyName f2 2023-02-12 03:03:43,607 DEBUG [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(539): loaded hdfs://localhost:37941/user/jenkins/test-data/7fc62549-5706-9fb9-8b29-23e946e690bb/testWithMapReduceAndOfflineHBaseMultiRegion/109d1960-4065-44e3-a86e-0ec3ac78f4ad/data/default/testWithMapReduce/c7ec9d775b089edec9ee11974e984f1a/f2/testWithMapReduce=c7ec9d775b089edec9ee11974e984f1a-2d459a9a57d9436ab5c254a4e36d15f4 2023-02-12 03:03:43,607 INFO [StoreOpener-c7ec9d775b089edec9ee11974e984f1a-1] regionserver.HStore(310): Store=c7ec9d775b089edec9ee11974e984f1a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:43,607 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:43,608 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c7ec9d775b089edec9ee11974e984f1a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72036974, jitterRate=0.07343456149101257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:43,608 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c7ec9d775b089edec9ee11974e984f1a: Writing region info on filesystem at 1676171023592Initializing all the Stores at 1676171023593 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023593Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171023593Region opened successfully at 1676171023608 (+15 ms) 2023-02-12 03:03:43,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c7ec9d775b089edec9ee11974e984f1a, disabling compactions & flushes 2023-02-12 03:03:43,635 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:43,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:43,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. after waiting 0 ms 2023-02-12 03:03:43,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:43,635 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676171016876.c7ec9d775b089edec9ee11974e984f1a. 2023-02-12 03:03:43,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c7ec9d775b089edec9ee11974e984f1a: Waiting for close lock at 1676171023634Disabling compacts and flushes for region at 1676171023634Disabling writes for close at 1676171023635 (+1 ms)Writing region close event to WAL at 1676171023635Closed at 1676171023635 2023-02-12 03:03:44,108 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:03:44,109 WARN [Listener at localhost/40969] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:44,113 INFO [Listener at localhost/40969] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:44,216 WARN [BP-1317088577-172.31.2.20-1676171014710 heartbeating to localhost/127.0.0.1:37941] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:44,217 WARN [BP-1317088577-172.31.2.20-1676171014710 heartbeating to localhost/127.0.0.1:37941] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1317088577-172.31.2.20-1676171014710 (Datanode Uuid ba987207-33a3-4644-9277-18e65f2ac9b1) service to localhost/127.0.0.1:37941 2023-02-12 03:03:44,218 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/dfs/data/data3/current/BP-1317088577-172.31.2.20-1676171014710] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:44,219 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/dfs/data/data4/current/BP-1317088577-172.31.2.20-1676171014710] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:44,220 WARN [Listener at localhost/40969] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:44,228 INFO [Listener at localhost/40969] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:44,331 WARN [BP-1317088577-172.31.2.20-1676171014710 heartbeating to localhost/127.0.0.1:37941] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:44,331 WARN [BP-1317088577-172.31.2.20-1676171014710 heartbeating to localhost/127.0.0.1:37941] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1317088577-172.31.2.20-1676171014710 (Datanode Uuid 47cab12f-b06d-41ee-89b8-d07131a1f48e) service to localhost/127.0.0.1:37941 2023-02-12 03:03:44,332 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/dfs/data/data1/current/BP-1317088577-172.31.2.20-1676171014710] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:44,333 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/cluster_e4c8b2e4-f972-8613-51c4-4855bf6180fa/dfs/data/data2/current/BP-1317088577-172.31.2.20-1676171014710] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:44,343 INFO [Listener at localhost/40969] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:44,464 INFO [Listener at localhost/40969] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:03:44,509 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:03:44,524 INFO [Listener at localhost/40969] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 102) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:37941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:37941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,39959,1676171015360)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:37941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:37941 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:37941 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/40969 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:37941 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=537 (was 531) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 208) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5499 (was 5722) 2023-02-12 03:03:44,535 INFO [Listener at localhost/40969] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=537, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=167, AvailableMemoryMB=5499 2023-02-12 03:03:44,545 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.log.dir so I do NOT create it in target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6 2023-02-12 03:03:44,545 WARN [Listener at localhost/40969] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:03:44,545 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.tmp.dir so I do NOT create it in target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6 2023-02-12 03:03:44,545 WARN [Listener at localhost/40969] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e351c390-33d5-57af-b61d-e1228d7fb03c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:03:44,545 DEBUG [Listener at localhost/40969] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd, deleteOnExit=true 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/test.cache.data in system properties and HBase conf 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:03:44,546 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:03:44,546 DEBUG [Listener at localhost/40969] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:03:44,547 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:03:44,548 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:03:44,548 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:44,548 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:03:44,548 INFO [Listener at localhost/40969] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:03:44,552 WARN [Listener at localhost/40969] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:44,552 WARN [Listener at localhost/40969] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:44,591 WARN [Listener at localhost/40969] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:44,594 INFO [Listener at localhost/40969] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:44,599 INFO [Listener at localhost/40969] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/java.io.tmpdir/Jetty_localhost_39647_hdfs____n7y4sd/webapp 2023-02-12 03:03:44,691 INFO [Listener at localhost/40969] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39647 2023-02-12 03:03:44,695 WARN [Listener at localhost/40969] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:44,695 WARN [Listener at localhost/40969] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:44,747 WARN [Listener at localhost/33191] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:44,759 WARN [Listener at localhost/33191] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:44,762 WARN [Listener at localhost/33191] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:44,763 INFO [Listener at localhost/33191] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:44,768 INFO [Listener at localhost/33191] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/java.io.tmpdir/Jetty_localhost_34245_datanode____k6a7tl/webapp 2023-02-12 03:03:44,862 INFO [Listener at localhost/33191] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34245 2023-02-12 03:03:44,871 WARN [Listener at localhost/36631] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:44,891 WARN [Listener at localhost/36631] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:44,893 WARN [Listener at localhost/36631] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:44,894 INFO [Listener at localhost/36631] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:44,908 INFO [Listener at localhost/36631] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/java.io.tmpdir/Jetty_localhost_35465_datanode____.q5nz2g/webapp 2023-02-12 03:03:45,005 INFO [Listener at localhost/36631] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35465 2023-02-12 03:03:45,017 WARN [Listener at localhost/43427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:45,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4412e1f7e4c9cb0: Processing first storage report for DS-a156d34c-dd02-4f43-b2eb-6658a8866406 from datanode 142ab8ba-1108-41cc-a939-9f46fa1b181a 2023-02-12 03:03:45,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4412e1f7e4c9cb0: from storage DS-a156d34c-dd02-4f43-b2eb-6658a8866406 node DatanodeRegistration(127.0.0.1:40375, datanodeUuid=142ab8ba-1108-41cc-a939-9f46fa1b181a, infoPort=46327, infoSecurePort=0, ipcPort=36631, storageInfo=lv=-57;cid=testClusterID;nsid=663295625;c=1676171024554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:45,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb4412e1f7e4c9cb0: Processing first storage report for DS-fcae6204-00e5-4555-8d79-576dfcb6eed2 from datanode 142ab8ba-1108-41cc-a939-9f46fa1b181a 2023-02-12 03:03:45,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb4412e1f7e4c9cb0: from storage DS-fcae6204-00e5-4555-8d79-576dfcb6eed2 node DatanodeRegistration(127.0.0.1:40375, datanodeUuid=142ab8ba-1108-41cc-a939-9f46fa1b181a, infoPort=46327, infoSecurePort=0, ipcPort=36631, storageInfo=lv=-57;cid=testClusterID;nsid=663295625;c=1676171024554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:45,325 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb8de75c69b0fa2be: Processing first storage report for DS-3ac13683-bbfd-4341-9f53-27fa776b6495 from datanode 4f20378c-da55-48e8-8bf9-4f022c19ff1a 2023-02-12 03:03:45,325 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb8de75c69b0fa2be: from storage DS-3ac13683-bbfd-4341-9f53-27fa776b6495 node DatanodeRegistration(127.0.0.1:34619, datanodeUuid=4f20378c-da55-48e8-8bf9-4f022c19ff1a, infoPort=39999, infoSecurePort=0, ipcPort=43427, storageInfo=lv=-57;cid=testClusterID;nsid=663295625;c=1676171024554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:45,326 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb8de75c69b0fa2be: Processing first storage report for DS-4c97a42b-a8d1-4a85-ac84-10a5bdb6a02f from datanode 4f20378c-da55-48e8-8bf9-4f022c19ff1a 2023-02-12 03:03:45,326 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb8de75c69b0fa2be: from storage DS-4c97a42b-a8d1-4a85-ac84-10a5bdb6a02f node DatanodeRegistration(127.0.0.1:34619, datanodeUuid=4f20378c-da55-48e8-8bf9-4f022c19ff1a, infoPort=39999, infoSecurePort=0, ipcPort=43427, storageInfo=lv=-57;cid=testClusterID;nsid=663295625;c=1676171024554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:45,331 DEBUG [Listener at localhost/43427] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6 2023-02-12 03:03:45,333 INFO [Listener at localhost/43427] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/zookeeper_0, clientPort=55871, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:03:45,334 INFO [Listener at localhost/43427] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55871 2023-02-12 03:03:45,334 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,335 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,351 INFO [Listener at localhost/43427] util.FSUtils(479): Created version file at hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b with version=8 2023-02-12 03:03:45,351 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,352 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,353 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33191/user/jenkins/test-data/9732144d-2077-b29c-7065-9781d0db19b2/hbase-staging 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:45,355 INFO [Listener at localhost/43427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:45,357 INFO [Listener at localhost/43427] ipc.NettyRpcServer(120): Bind to /172.31.2.20:36949 2023-02-12 03:03:45,357 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,358 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,359 INFO [Listener at localhost/43427] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36949 connecting to ZooKeeper ensemble=127.0.0.1:55871 2023-02-12 03:03:45,365 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:369490x0, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:45,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36949-0x10154e94ff90000 connected 2023-02-12 03:03:45,384 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:45,384 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:45,385 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:45,385 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-12 03:03:45,386 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36949 2023-02-12 03:03:45,386 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36949 2023-02-12 03:03:45,387 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-12 03:03:45,388 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36949 2023-02-12 03:03:45,388 INFO [Listener at localhost/43427] master.HMaster(439): hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b, hbase.cluster.distributed=false 2023-02-12 03:03:45,400 INFO [Listener at localhost/43427] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:45,400 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,401 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,401 INFO [Listener at localhost/43427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:45,401 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,401 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:45,401 INFO [Listener at localhost/43427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:45,405 INFO [Listener at localhost/43427] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44503 2023-02-12 03:03:45,406 INFO [Listener at localhost/43427] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:45,407 DEBUG [Listener at localhost/43427] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:45,408 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,409 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,409 INFO [Listener at localhost/43427] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44503 connecting to ZooKeeper ensemble=127.0.0.1:55871 2023-02-12 03:03:45,412 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:445030x0, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:45,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44503-0x10154e94ff90001 connected 2023-02-12 03:03:45,414 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:45,415 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:45,416 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:45,419 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-12 03:03:45,419 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44503 2023-02-12 03:03:45,420 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44503 2023-02-12 03:03:45,422 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-12 03:03:45,422 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44503 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:45,434 INFO [Listener at localhost/43427] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:45,439 INFO [Listener at localhost/43427] ipc.NettyRpcServer(120): Bind to /172.31.2.20:36463 2023-02-12 03:03:45,439 INFO [Listener at localhost/43427] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:45,440 DEBUG [Listener at localhost/43427] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:45,441 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,442 INFO [Listener at localhost/43427] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,443 INFO [Listener at localhost/43427] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36463 connecting to ZooKeeper ensemble=127.0.0.1:55871 2023-02-12 03:03:45,447 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:364630x0, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:45,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36463-0x10154e94ff90002 connected 2023-02-12 03:03:45,449 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:45,450 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:45,450 DEBUG [Listener at localhost/43427] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:45,453 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36463 2023-02-12 03:03:45,453 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36463 2023-02-12 03:03:45,453 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36463 2023-02-12 03:03:45,455 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36463 2023-02-12 03:03:45,456 DEBUG [Listener at localhost/43427] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36463 2023-02-12 03:03:45,459 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,460 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:45,460 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,462 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:45,462 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:45,462 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,462 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:45,463 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:45,464 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,36949,1676171025354 from backup master directory 2023-02-12 03:03:45,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:45,465 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,465 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:45,465 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:45,465 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,480 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/hbase.id with ID: c79376d3-b001-4350-b65b-d84532e4dc3a 2023-02-12 03:03:45,490 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:45,494 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,502 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0aa8780e to 127.0.0.1:55871 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:45,507 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28eb45da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:45,508 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:45,508 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:03:45,508 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:45,509 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store-tmp 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:45,518 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:45,518 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:45,518 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171025518Disabling compacts and flushes for region at 1676171025518Disabling writes for close at 1676171025518Writing region close event to WAL at 1676171025518Closed at 1676171025518 2023-02-12 03:03:45,519 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/WALs/jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,522 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C36949%2C1676171025354, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/WALs/jenkins-hbase6.apache.org,36949,1676171025354, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/oldWALs, maxLogs=10 2023-02-12 03:03:45,544 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK] 2023-02-12 03:03:45,544 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK] 2023-02-12 03:03:45,547 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/WALs/jenkins-hbase6.apache.org,36949,1676171025354/jenkins-hbase6.apache.org%2C36949%2C1676171025354.1676171025522 2023-02-12 03:03:45,547 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK], DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK]] 2023-02-12 03:03:45,547 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:45,547 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:45,547 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,547 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,550 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,552 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:03:45,552 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:03:45,553 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,553 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,553 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,556 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:45,558 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:45,558 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65630979, jitterRate=-0.022022202610969543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:45,558 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171025548Initializing all the Stores at 1676171025548Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171025548Cleaning up temporary data from old regions at 1676171025554 (+6 ms)Cleaning up detritus from prior splits at 1676171025554Region opened successfully at 1676171025558 (+4 ms) 2023-02-12 03:03:45,558 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:03:45,559 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:03:45,560 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:03:45,560 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:03:45,560 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:03:45,560 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:03:45,560 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:03:45,561 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:03:45,562 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:03:45,573 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:03:45,573 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:03:45,573 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:03:45,573 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:03:45,574 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:03:45,576 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,576 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:03:45,576 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:03:45,577 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:03:45,578 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:45,578 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:45,578 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:45,579 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,579 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,36949,1676171025354, sessionid=0x10154e94ff90000, setting cluster-up flag (Was=false) 2023-02-12 03:03:45,584 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,589 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:03:45,590 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,592 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,596 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:03:45,597 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:45,598 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/.tmp 2023-02-12 03:03:45,599 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:45,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171055602 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:03:45,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:03:45,603 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,603 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:45,603 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:03:45,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171025604,5,FailOnTimeoutGroup] 2023-02-12 03:03:45,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171025604,5,FailOnTimeoutGroup] 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,604 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,605 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:45,614 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:45,615 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:45,615 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b 2023-02-12 03:03:45,625 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:45,626 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:45,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/info 2023-02-12 03:03:45,628 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:45,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:45,630 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:45,630 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:45,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:45,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/table 2023-02-12 03:03:45,632 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:45,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,633 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740 2023-02-12 03:03:45,633 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740 2023-02-12 03:03:45,635 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:45,636 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:45,637 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:45,638 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67563783, jitterRate=0.006778821349143982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171025625Initializing all the Stores at 1676171025626 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171025626Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171025626Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171025626Cleaning up temporary data from old regions at 1676171025634 (+8 ms)Cleaning up detritus from prior splits at 1676171025634Region opened successfully at 1676171025638 (+4 ms) 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:45,638 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:45,638 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:45,638 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171025638Disabling compacts and flushes for region at 1676171025638Disabling writes for close at 1676171025638Writing region close event to WAL at 1676171025638Closed at 1676171025638 2023-02-12 03:03:45,639 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:45,639 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:03:45,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:03:45,641 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:03:45,642 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:03:45,659 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(952): ClusterId : c79376d3-b001-4350-b65b-d84532e4dc3a 2023-02-12 03:03:45,659 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(952): ClusterId : c79376d3-b001-4350-b65b-d84532e4dc3a 2023-02-12 03:03:45,659 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:45,659 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:45,661 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:45,661 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:45,661 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:45,661 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:45,664 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:45,665 DEBUG [RS:0;jenkins-hbase6:44503] zookeeper.ReadOnlyZKClient(139): Connect 0x5e46c372 to 127.0.0.1:55871 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:45,665 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:45,666 DEBUG [RS:1;jenkins-hbase6:36463] zookeeper.ReadOnlyZKClient(139): Connect 0x12bf159b to 127.0.0.1:55871 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:45,671 DEBUG [RS:0;jenkins-hbase6:44503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@508126ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:45,671 DEBUG [RS:0;jenkins-hbase6:44503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54bea802, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:45,671 DEBUG [RS:1;jenkins-hbase6:36463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c78f9bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:45,671 DEBUG [RS:1;jenkins-hbase6:36463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18477eeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:45,680 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:36463 2023-02-12 03:03:45,680 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:44503 2023-02-12 03:03:45,680 INFO [RS:1;jenkins-hbase6:36463] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:45,680 INFO [RS:1;jenkins-hbase6:36463] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:45,680 INFO [RS:0;jenkins-hbase6:44503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:45,680 INFO [RS:0;jenkins-hbase6:44503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:45,680 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:45,680 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:45,680 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,36949,1676171025354 with isa=jenkins-hbase6.apache.org/172.31.2.20:44503, startcode=1676171025400 2023-02-12 03:03:45,680 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,36949,1676171025354 with isa=jenkins-hbase6.apache.org/172.31.2.20:36463, startcode=1676171025433 2023-02-12 03:03:45,681 DEBUG [RS:0;jenkins-hbase6:44503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:45,681 DEBUG [RS:1;jenkins-hbase6:36463] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:45,683 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:57429, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:45,683 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38805, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:45,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36949] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,685 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,685 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b 2023-02-12 03:03:45,685 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b 2023-02-12 03:03:45,685 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33191 2023-02-12 03:03:45,685 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33191 2023-02-12 03:03:45,685 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:45,685 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:45,694 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:45,695 DEBUG [RS:0;jenkins-hbase6:44503] zookeeper.ZKUtil(162): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,695 DEBUG [RS:1;jenkins-hbase6:36463] zookeeper.ZKUtil(162): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,695 WARN [RS:0;jenkins-hbase6:44503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:45,695 WARN [RS:1;jenkins-hbase6:36463] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:45,695 INFO [RS:0;jenkins-hbase6:44503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:45,695 INFO [RS:1;jenkins-hbase6:36463] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:45,696 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,696 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,696 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44503,1676171025400] 2023-02-12 03:03:45,696 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,36463,1676171025433] 2023-02-12 03:03:45,701 DEBUG [RS:1;jenkins-hbase6:36463] zookeeper.ZKUtil(162): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,701 DEBUG [RS:0;jenkins-hbase6:44503] zookeeper.ZKUtil(162): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,701 DEBUG [RS:1;jenkins-hbase6:36463] zookeeper.ZKUtil(162): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,701 DEBUG [RS:0;jenkins-hbase6:44503] zookeeper.ZKUtil(162): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,702 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:45,702 DEBUG [RS:1;jenkins-hbase6:36463] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:45,702 INFO [RS:0;jenkins-hbase6:44503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:45,702 INFO [RS:1;jenkins-hbase6:36463] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:45,703 INFO [RS:0;jenkins-hbase6:44503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:45,706 INFO [RS:0;jenkins-hbase6:44503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:45,706 INFO [RS:1;jenkins-hbase6:36463] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:45,706 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,707 INFO [RS:1;jenkins-hbase6:36463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:45,707 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:45,707 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,710 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:45,710 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,711 DEBUG [RS:0;jenkins-hbase6:44503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,712 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,713 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,713 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,713 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:45,713 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,714 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,714 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,714 DEBUG [RS:1;jenkins-hbase6:36463] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:45,714 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,714 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,714 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,725 INFO [RS:0;jenkins-hbase6:44503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:45,725 INFO [RS:1;jenkins-hbase6:36463] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:45,725 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44503,1676171025400-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,725 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36463,1676171025433-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:45,736 INFO [RS:0;jenkins-hbase6:44503] regionserver.Replication(203): jenkins-hbase6.apache.org,44503,1676171025400 started 2023-02-12 03:03:45,736 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44503,1676171025400, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44503, sessionid=0x10154e94ff90001 2023-02-12 03:03:45,736 INFO [RS:1;jenkins-hbase6:36463] regionserver.Replication(203): jenkins-hbase6.apache.org,36463,1676171025433 started 2023-02-12 03:03:45,736 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:45,736 DEBUG [RS:0;jenkins-hbase6:44503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,736 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,36463,1676171025433, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:36463, sessionid=0x10154e94ff90002 2023-02-12 03:03:45,736 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44503,1676171025400' 2023-02-12 03:03:45,736 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:45,736 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:45,736 DEBUG [RS:1;jenkins-hbase6:36463] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,736 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,36463,1676171025433' 2023-02-12 03:03:45,736 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:45,736 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,36463,1676171025433' 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44503,1676171025400' 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:45,737 DEBUG [RS:1;jenkins-hbase6:36463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:45,737 DEBUG [RS:0;jenkins-hbase6:44503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:45,738 DEBUG [RS:1;jenkins-hbase6:36463] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:45,738 INFO [RS:1;jenkins-hbase6:36463] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:45,738 DEBUG [RS:0;jenkins-hbase6:44503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:45,738 INFO [RS:1;jenkins-hbase6:36463] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:45,738 INFO [RS:0;jenkins-hbase6:44503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:45,738 INFO [RS:0;jenkins-hbase6:44503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:45,793 DEBUG [jenkins-hbase6:36949] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:03:45,793 DEBUG [jenkins-hbase6:36949] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:45,795 DEBUG [jenkins-hbase6:36949] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:45,795 DEBUG [jenkins-hbase6:36949] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:45,795 DEBUG [jenkins-hbase6:36949] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:45,796 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44503,1676171025400, state=OPENING 2023-02-12 03:03:45,797 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:03:45,798 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:45,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44503,1676171025400}] 2023-02-12 03:03:45,799 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:45,952 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:45,952 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:45,954 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:45,958 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:03:45,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:45,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44503%2C1676171025400.meta, suffix=.meta, logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,44503,1676171025400, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs, maxLogs=32 2023-02-12 03:03:45,974 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK] 2023-02-12 03:03:45,974 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK] 2023-02-12 03:03:45,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,44503,1676171025400/jenkins-hbase6.apache.org%2C44503%2C1676171025400.meta.1676171025960.meta 2023-02-12 03:03:45,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK], DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK]] 2023-02-12 03:03:45,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:45,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:03:45,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:03:45,977 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:03:45,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:03:45,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:45,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:03:45,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:03:45,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:45,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/info 2023-02-12 03:03:45,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/info 2023-02-12 03:03:45,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:45,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:45,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:45,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:45,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:45,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:45,983 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/table 2023-02-12 03:03:45,983 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/table 2023-02-12 03:03:45,983 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:45,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:45,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740 2023-02-12 03:03:45,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740 2023-02-12 03:03:45,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:45,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:45,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65532761, jitterRate=-0.023485764861106873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:45,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171025977Writing region info on filesystem at 1676171025977Initializing all the Stores at 1676171025978 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171025978Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171025978Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171025978Cleaning up temporary data from old regions at 1676171025985 (+7 ms)Cleaning up detritus from prior splits at 1676171025986 (+1 ms)Running coprocessor post-open hooks at 1676171025988 (+2 ms)Region opened successfully at 1676171025988 2023-02-12 03:03:45,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171025952 2023-02-12 03:03:45,993 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:03:45,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:03:45,993 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44503,1676171025400, state=OPEN 2023-02-12 03:03:45,995 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:03:45,995 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:45,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:03:45,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44503,1676171025400 in 197 msec 2023-02-12 03:03:45,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:03:45,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-12 03:03:46,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-12 03:03:46,000 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171025460, completionTime=-1 2023-02-12 03:03:46,000 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:03:46,000 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:03:46,008 DEBUG [hconnection-0x6ad85701-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:46,010 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:46,012 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:03:46,012 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171086012 2023-02-12 03:03:46,012 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171146012 2023-02-12 03:03:46,012 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36949,1676171025354-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36949,1676171025354-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36949,1676171025354-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:36949, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:46,021 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:03:46,022 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:46,023 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:03:46,024 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:03:46,024 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:46,025 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:46,027 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,028 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee empty. 2023-02-12 03:03:46,028 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,028 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:03:46,041 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:46,042 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e4bbabd552d27442eb22f9975c2bb6ee, NAME => 'hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e4bbabd552d27442eb22f9975c2bb6ee, disabling compactions & flushes 2023-02-12 03:03:46,051 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. after waiting 0 ms 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,051 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e4bbabd552d27442eb22f9975c2bb6ee: Waiting for close lock at 1676171026051Disabling compacts and flushes for region at 1676171026051Disabling writes for close at 1676171026051Writing region close event to WAL at 1676171026051Closed at 1676171026051 2023-02-12 03:03:46,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:46,055 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171026055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171026055"}]},"ts":"1676171026055"} 2023-02-12 03:03:46,057 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:46,058 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:46,058 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171026058"}]},"ts":"1676171026058"} 2023-02-12 03:03:46,059 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:03:46,062 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:46,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:46,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:46,063 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:46,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4bbabd552d27442eb22f9975c2bb6ee, ASSIGN}] 2023-02-12 03:03:46,065 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e4bbabd552d27442eb22f9975c2bb6ee, ASSIGN 2023-02-12 03:03:46,066 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e4bbabd552d27442eb22f9975c2bb6ee, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44503,1676171025400; forceNewPlan=false, retain=false 2023-02-12 03:03:46,216 INFO [jenkins-hbase6:36949] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:46,217 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4bbabd552d27442eb22f9975c2bb6ee, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:46,217 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171026217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171026217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171026217"}]},"ts":"1676171026217"} 2023-02-12 03:03:46,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e4bbabd552d27442eb22f9975c2bb6ee, server=jenkins-hbase6.apache.org,44503,1676171025400}] 2023-02-12 03:03:46,375 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,376 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44503%2C1676171025400, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,44503,1676171025400, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs, maxLogs=32 2023-02-12 03:03:46,390 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK] 2023-02-12 03:03:46,391 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK] 2023-02-12 03:03:46,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,44503,1676171025400/jenkins-hbase6.apache.org%2C44503%2C1676171025400.1676171026377 2023-02-12 03:03:46,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK], DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK]] 2023-02-12 03:03:46,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4bbabd552d27442eb22f9975c2bb6ee, NAME => 'hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:46,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:46,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,395 INFO [StoreOpener-e4bbabd552d27442eb22f9975c2bb6ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,396 DEBUG [StoreOpener-e4bbabd552d27442eb22f9975c2bb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/info 2023-02-12 03:03:46,396 DEBUG [StoreOpener-e4bbabd552d27442eb22f9975c2bb6ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/info 2023-02-12 03:03:46,397 INFO [StoreOpener-e4bbabd552d27442eb22f9975c2bb6ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4bbabd552d27442eb22f9975c2bb6ee columnFamilyName info 2023-02-12 03:03:46,397 INFO [StoreOpener-e4bbabd552d27442eb22f9975c2bb6ee-1] regionserver.HStore(310): Store=e4bbabd552d27442eb22f9975c2bb6ee/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:46,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:46,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:46,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened e4bbabd552d27442eb22f9975c2bb6ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59728560, jitterRate=-0.10997509956359863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:46,402 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for e4bbabd552d27442eb22f9975c2bb6ee: Running coprocessor pre-open hook at 1676171026394Writing region info on filesystem at 1676171026394Initializing all the Stores at 1676171026395 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171026395Cleaning up temporary data from old regions at 1676171026398 (+3 ms)Cleaning up detritus from prior splits at 1676171026399 (+1 ms)Running coprocessor post-open hooks at 1676171026402 (+3 ms)Region opened successfully at 1676171026402 2023-02-12 03:03:46,403 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee., pid=6, masterSystemTime=1676171026371 2023-02-12 03:03:46,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:46,405 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e4bbabd552d27442eb22f9975c2bb6ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:46,405 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171026405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171026405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171026405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171026405"}]},"ts":"1676171026405"} 2023-02-12 03:03:46,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:03:46,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e4bbabd552d27442eb22f9975c2bb6ee, server=jenkins-hbase6.apache.org,44503,1676171025400 in 188 msec 2023-02-12 03:03:46,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:03:46,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e4bbabd552d27442eb22f9975c2bb6ee, ASSIGN in 345 msec 2023-02-12 03:03:46,411 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:46,411 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171026411"}]},"ts":"1676171026411"} 2023-02-12 03:03:46,412 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:03:46,417 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:46,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 395 msec 2023-02-12 03:03:46,424 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:03:46,426 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:46,426 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:46,430 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:03:46,438 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:46,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 03:03:46,452 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:03:46,461 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:46,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-12 03:03:46,477 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:03:46,479 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.015sec 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36949,1676171025354-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:03:46,480 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36949,1676171025354-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:03:46,481 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:03:46,559 DEBUG [Listener at localhost/43427] zookeeper.ReadOnlyZKClient(139): Connect 0x12bc598c to 127.0.0.1:55871 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:46,565 DEBUG [Listener at localhost/43427] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66a2dcef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:46,567 DEBUG [hconnection-0x80c6d04-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:46,568 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60324, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:46,570 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:46,570 DEBUG [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:03:46,572 DEBUG [Listener at localhost/43427] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:03:46,574 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:03:46,575 INFO [Listener at localhost/43427] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:46,575 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:46,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:03:46,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.2.20:56960 deadline: 1676171086575, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:46,576 INFO [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 03:03:46,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:46,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:46,583 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:46,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-12 03:03:46,583 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:46,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:46,585 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:46,585 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 empty. 2023-02-12 03:03:46,586 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:46,586 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 03:03:46,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:46,740 INFO [RS:1;jenkins-hbase6:36463] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C36463%2C1676171025433, suffix=, logDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,36463,1676171025433, archiveDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs, maxLogs=32 2023-02-12 03:03:46,756 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK] 2023-02-12 03:03:46,756 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK] 2023-02-12 03:03:46,758 INFO [RS:1;jenkins-hbase6:36463] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/WALs/jenkins-hbase6.apache.org,36463,1676171025433/jenkins-hbase6.apache.org%2C36463%2C1676171025433.1676171026740 2023-02-12 03:03:46,758 DEBUG [RS:1;jenkins-hbase6:36463] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34619,DS-3ac13683-bbfd-4341-9f53-27fa776b6495,DISK], DatanodeInfoWithStorage[127.0.0.1:40375,DS-a156d34c-dd02-4f43-b2eb-6658a8866406,DISK]] 2023-02-12 03:03:46,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:46,996 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:46,997 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14791f61f4a4d2190a519f0067b265f5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 14791f61f4a4d2190a519f0067b265f5, disabling compactions & flushes 2023-02-12 03:03:47,004 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. after waiting 0 ms 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,004 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,004 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 14791f61f4a4d2190a519f0067b265f5: Waiting for close lock at 1676171027004Disabling compacts and flushes for region at 1676171027004Disabling writes for close at 1676171027004Writing region close event to WAL at 1676171027004Closed at 1676171027004 2023-02-12 03:03:47,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:47,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676171027007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171027007"}]},"ts":"1676171027007"} 2023-02-12 03:03:47,009 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:47,010 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:47,010 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171027010"}]},"ts":"1676171027010"} 2023-02-12 03:03:47,011 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-12 03:03:47,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:47,017 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:47,017 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:47,017 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:47,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, ASSIGN}] 2023-02-12 03:03:47,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, ASSIGN 2023-02-12 03:03:47,020 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36463,1676171025433; forceNewPlan=false, retain=false 2023-02-12 03:03:47,170 INFO [jenkins-hbase6:36949] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:47,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=14791f61f4a4d2190a519f0067b265f5, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,172 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676171027171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171027171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171027171"}]},"ts":"1676171027171"} 2023-02-12 03:03:47,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 14791f61f4a4d2190a519f0067b265f5, server=jenkins-hbase6.apache.org,36463,1676171025433}] 2023-02-12 03:03:47,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:47,327 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,327 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:47,329 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:47,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 14791f61f4a4d2190a519f0067b265f5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,334 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,335 DEBUG [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1 2023-02-12 03:03:47,335 DEBUG [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1 2023-02-12 03:03:47,335 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14791f61f4a4d2190a519f0067b265f5 columnFamilyName f1 2023-02-12 03:03:47,336 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] regionserver.HStore(310): Store=14791f61f4a4d2190a519f0067b265f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:47,336 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,337 DEBUG [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2 2023-02-12 03:03:47,337 DEBUG [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2 2023-02-12 03:03:47,337 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14791f61f4a4d2190a519f0067b265f5 columnFamilyName f2 2023-02-12 03:03:47,338 INFO [StoreOpener-14791f61f4a4d2190a519f0067b265f5-1] regionserver.HStore(310): Store=14791f61f4a4d2190a519f0067b265f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:47,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:47,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:47,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:47,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 14791f61f4a4d2190a519f0067b265f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61986622, jitterRate=-0.0763273537158966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:47,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 14791f61f4a4d2190a519f0067b265f5: Running coprocessor pre-open hook at 1676171027333Writing region info on filesystem at 1676171027333Initializing all the Stores at 1676171027334 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171027334Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171027334Cleaning up temporary data from old regions at 1676171027340 (+6 ms)Cleaning up detritus from prior splits at 1676171027340Running coprocessor post-open hooks at 1676171027345 (+5 ms)Region opened successfully at 1676171027345 2023-02-12 03:03:47,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5., pid=12, masterSystemTime=1676171027327 2023-02-12 03:03:47,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=14791f61f4a4d2190a519f0067b265f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,351 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676171027351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171027351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171027351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171027351"}]},"ts":"1676171027351"} 2023-02-12 03:03:47,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 03:03:47,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 14791f61f4a4d2190a519f0067b265f5, server=jenkins-hbase6.apache.org,36463,1676171025433 in 179 msec 2023-02-12 03:03:47,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 03:03:47,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, ASSIGN in 337 msec 2023-02-12 03:03:47,356 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:47,357 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171027356"}]},"ts":"1676171027356"} 2023-02-12 03:03:47,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-12 03:03:47,360 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:47,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 780 msec 2023-02-12 03:03:47,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:47,692 INFO [Listener at localhost/43427] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-12 03:03:47,692 DEBUG [Listener at localhost/43427] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-12 03:03:47,692 INFO [Listener at localhost/43427] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:47,694 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-12 03:03:47,694 INFO [Listener at localhost/43427] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:47,694 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-12 03:03:47,694 INFO [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:03:47,716 DEBUG [hconnection-0x80c6d04-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:47,737 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:47,786 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36463] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,894 INFO [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:03:47,894 INFO [Listener at localhost/43427] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:03:47,896 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 03:03:47,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171027896 (current time:1676171027896). 2023-02-12 03:03:47,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:03:47,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] zookeeper.ReadOnlyZKClient(139): Connect 0x297e0e81 to 127.0.0.1:55871 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:47,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27ef845, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:47,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:47,904 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:60326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:47,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297e0e81 to 127.0.0.1:55871 2023-02-12 03:03:47,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:03:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 03:03:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 03:03:47,909 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 03:03:47,910 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676171627910 2023-02-12 03:03:47,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 03:03:47,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:47,911 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:47,911 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:03:47,912 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 03:03:47,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 03:03:47,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-12 03:03:47,914 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 03:03:47,914 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676171627914 2023-02-12 03:03:47,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 03:03:47,926 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 03:03:47,926 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:47,927 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 03:03:47,927 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 03:03:47,927 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:03:47,927 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:03:47,930 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:47,930 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:47,930 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:47,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:47,931 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,931 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:47,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 03:03:47,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:03:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 03:03:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:03:47,932 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 03:03:47,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 03:03:47,932 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 03:03:47,932 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:47,933 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 03:03:47,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:47,933 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 03:03:47,933 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44503,1676171025400' joining acquired barrier for procedure (foo) in zk 2023-02-12 03:03:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 03:03:47,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:03:47,935 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 03:03:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:03:47,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 03:03:47,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 03:03:47,936 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,936 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:47,936 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 03:03:47,936 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:47,937 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 03:03:47,937 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 03:03:47,937 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36463,1676171025433' joining acquired barrier for procedure (foo) in zk 2023-02-12 03:03:47,938 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,938 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:47,938 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,939 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:47,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36463,1676171025433' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 03:03:47,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@117d82f7[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:47,940 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 03:03:47,941 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,44503,1676171025400' in zk 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 03:03:47,942 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:47,942 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:47,942 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. started... 2023-02-12 03:03:47,944 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 14791f61f4a4d2190a519f0067b265f5 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 03:03:47,946 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 03:03:47,946 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:47,946 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 03:03:47,947 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:47,947 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:47,967 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f1/95c4279c24094d2d81fdb679a79f56a2 2023-02-12 03:03:47,985 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f2/6f09e26ff3d14a4baced526d5ac7b195 2023-02-12 03:03:47,990 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f1/95c4279c24094d2d81fdb679a79f56a2 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2 2023-02-12 03:03:47,994 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:03:47,995 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f2/6f09e26ff3d14a4baced526d5ac7b195 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195 2023-02-12 03:03:47,999 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:03:48,000 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 14791f61f4a4d2190a519f0067b265f5 in 56ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:48,000 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 03:03:48,000 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 14791f61f4a4d2190a519f0067b265f5: 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.' region-info for snapshot=foo 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2] hfiles 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2 for snapshot=foo 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195] hfiles 2023-02-12 03:03:48,001 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195 for snapshot=foo 2023-02-12 03:03:48,010 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. completed. 2023-02-12 03:03:48,010 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,010 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 03:03:48,010 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 03:03:48,010 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,010 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 03:03:48,010 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,36463,1676171025433' in zk 2023-02-12 03:03:48,011 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:48,012 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 03:03:48,012 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:48,012 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:48,012 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 03:03:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:48,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 03:03:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:48,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:48,014 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:03:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase6.apache.org,36463,1676171025433': 2023-02-12 03:03:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36463,1676171025433' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 03:03:48,016 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 03:03:48,016 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:48,016 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:48,016 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 03:03:48,016 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:03:48,018 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:48,018 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:48,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:48,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:48,019 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:48,019 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,021 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:48,021 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:03:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,028 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:48,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 03:03:48,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 03:03:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:48,029 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:48,029 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,031 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:03:48,031 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,031 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:03:48,031 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:03:48,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/.tmp/foo 2023-02-12 03:03:48,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:48,214 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:48,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 03:03:48,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:48,216 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:03:48,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/.tmp/foo to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/foo 2023-02-12 03:03:48,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-12 03:03:48,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/.tmp/foo 2023-02-12 03:03:48,468 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.hbase-snapshot/.tmp/foo 2023-02-12 03:03:48,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676171027910Consolidate snapshot: foo at 1676171028029 (+119 ms)Loading Region manifests for foo at 1676171028029Writing data manifest for foo at 1676171028034 (+5 ms)Verifying snapshot: foo at 1676171028443 (+409 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676171028468 (+25 ms) 2023-02-12 03:03:48,470 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 03:03:48,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 559 msec 2023-02-12 03:03:48,516 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 03:03:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:03:48,518 INFO [Listener at localhost/43427] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:03:48,522 INFO [Listener at localhost/43427] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:03:48,528 INFO [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:03:48,576 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36463] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,682 INFO [Listener at localhost/43427] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:03:48,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:03:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,690 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-12 03:03:48,690 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:48,691 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-12 03:03:48,691 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-12 03:03:48,692 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,692 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,693 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:48,693 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:48,693 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:48,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:48,694 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,694 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,695 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 03:03:48,695 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:48,695 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 03:03:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 03:03:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 03:03:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44503,1676171025400' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 03:03:48,696 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:48,697 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 03:03:48,697 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:03:48,697 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:48,697 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,697 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. started... 2023-02-12 03:03:48,697 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 14791f61f4a4d2190a519f0067b265f5 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 03:03:48,700 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,701 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,701 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:48,716 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f1/7f9d1f8aa8e343a38559a571a2a02f3e 2023-02-12 03:03:48,743 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f2/f60f4d9ff3004dceb46590695d030b2a 2023-02-12 03:03:48,748 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f1/7f9d1f8aa8e343a38559a571a2a02f3e as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/7f9d1f8aa8e343a38559a571a2a02f3e 2023-02-12 03:03:48,753 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/7f9d1f8aa8e343a38559a571a2a02f3e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:03:48,754 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/.tmp/f2/f60f4d9ff3004dceb46590695d030b2a as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/f60f4d9ff3004dceb46590695d030b2a 2023-02-12 03:03:48,758 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/f60f4d9ff3004dceb46590695d030b2a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:03:48,759 INFO [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 14791f61f4a4d2190a519f0067b265f5 in 62ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:48,760 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 14791f61f4a4d2190a519f0067b265f5: 2023-02-12 03:03:48,760 DEBUG [rs(jenkins-hbase6.apache.org,36463,1676171025433)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,760 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:03:48,760 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:03:48,760 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,760 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 03:03:48,760 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36463,1676171025433' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 03:03:48,762 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,762 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:48,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:48,762 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,762 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:48,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36463,1676171025433' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-12 03:03:48,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15421400[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:48,764 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-12 03:03:48,764 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 03:03:48,767 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase6.apache.org,36463,1676171025433' in zk 2023-02-12 03:03:48,767 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase6.apache.org,44503,1676171025400' in zk 2023-02-12 03:03:48,767 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:48,769 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,769 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 03:03:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:48,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:48,769 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:48,769 DEBUG [member: 'jenkins-hbase6.apache.org,36463,1676171025433' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 03:03:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:48,770 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 03:03:48,770 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:48,770 DEBUG [member: 'jenkins-hbase6.apache.org,44503,1676171025400' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 03:03:48,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase6.apache.org,36463,1676171025433': 2023-02-12 03:03:48,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36463,1676171025433' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-12 03:03:48,774 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-12 03:03:48,774 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:48,774 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:48,774 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,774 INFO [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:03:48,776 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:48,776 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:48,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:48,777 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:48,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,777 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,779 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:48,779 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,783 DEBUG [(jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:48,783 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-12 03:03:48,784 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:03:48,783 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:48,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:48,784 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:48,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,785 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,885 DEBUG [Listener at localhost/43427] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:03:48,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:03:48,892 INFO [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676171027896 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:48,892 DEBUG [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33191/user/jenkins/test-data/9732144d-2077-b29c-7065-9781d0db19b2/foo/7577ee89-005e-4fc5-87e4-f43ef7a2b0df/data/default/testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,892 INFO [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(239): region to add: 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:48,892 INFO [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(585): clone region=14791f61f4a4d2190a519f0067b265f5 as 14791f61f4a4d2190a519f0067b265f5 in snapshot foo 2023-02-12 03:03:48,893 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 14791f61f4a4d2190a519f0067b265f5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33191/user/jenkins/test-data/9732144d-2077-b29c-7065-9781d0db19b2/foo/7577ee89-005e-4fc5-87e4-f43ef7a2b0df 2023-02-12 03:03:48,900 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:48,900 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 95c4279c24094d2d81fdb679a79f56a2 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,903 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6f09e26ff3d14a4baced526d5ac7b195 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 14791f61f4a4d2190a519f0067b265f5, disabling compactions & flushes 2023-02-12 03:03:48,905 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. after waiting 0 ms 2023-02-12 03:03:48,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,905 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:48,905 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 14791f61f4a4d2190a519f0067b265f5: Waiting for close lock at 1676171028905Disabling compacts and flushes for region at 1676171028905Disabling writes for close at 1676171028905Writing region close event to WAL at 1676171028905Closed at 1676171028905 2023-02-12 03:03:48,905 INFO [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676171027896 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:48,905 DEBUG [Listener at localhost/43427] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33191/user/jenkins/test-data/9732144d-2077-b29c-7065-9781d0db19b2/foo/7577ee89-005e-4fc5-87e4-f43ef7a2b0df 2023-02-12 03:03:48,905 DEBUG [Listener at localhost/43427] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33191/user/jenkins/test-data/9732144d-2077-b29c-7065-9781d0db19b2/foo/7577ee89-005e-4fc5-87e4-f43ef7a2b0df 2023-02-12 03:03:48,906 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |-data/ 2023-02-12 03:03:48,907 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |----default/ 2023-02-12 03:03:48,907 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-12 03:03:48,907 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |----------14791f61f4a4d2190a519f0067b265f5/ 2023-02-12 03:03:48,908 DEBUG [Listener at localhost/43427] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:48,908 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:48,908 DEBUG [Listener at localhost/43427] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=14791f61f4a4d2190a519f0067b265f5-95c4279c24094d2d81fdb679a79f56a2 2023-02-12 03:03:48,909 DEBUG [Listener at localhost/43427] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:48,909 DEBUG [Listener at localhost/43427] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=14791f61f4a4d2190a519f0067b265f5-6f09e26ff3d14a4baced526d5ac7b195 2023-02-12 03:03:48,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "foo" 2023-02-12 03:03:48,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 03:03:48,914 INFO [Listener at localhost/43427] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,915 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:48,919 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171028918"}]},"ts":"1676171028918"} 2023-02-12 03:03:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:03:48,920 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-12 03:03:48,922 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-12 03:03:48,922 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, UNASSIGN}] 2023-02-12 03:03:48,924 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, UNASSIGN 2023-02-12 03:03:48,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=14791f61f4a4d2190a519f0067b265f5, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:48,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676171028924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171028924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171028924"}]},"ts":"1676171028924"} 2023-02-12 03:03:48,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 14791f61f4a4d2190a519f0067b265f5, server=jenkins-hbase6.apache.org,36463,1676171025433}] 2023-02-12 03:03:49,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:03:49,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:49,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 14791f61f4a4d2190a519f0067b265f5, disabling compactions & flushes 2023-02-12 03:03:49,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:49,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:49,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. after waiting 0 ms 2023-02-12 03:03:49,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:49,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:49,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5. 2023-02-12 03:03:49,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 14791f61f4a4d2190a519f0067b265f5: Waiting for close lock at 1676171029079Running coprocessor pre-close hooks at 1676171029079Disabling compacts and flushes for region at 1676171029079Disabling writes for close at 1676171029079Writing region close event to WAL at 1676171029080 (+1 ms)Running coprocessor post-close hooks at 1676171029084 (+4 ms)Closed at 1676171029084 2023-02-12 03:03:49,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:49,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=14791f61f4a4d2190a519f0067b265f5, regionState=CLOSED 2023-02-12 03:03:49,086 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676171029086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171029086"}]},"ts":"1676171029086"} 2023-02-12 03:03:49,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 03:03:49,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 14791f61f4a4d2190a519f0067b265f5, server=jenkins-hbase6.apache.org,36463,1676171025433 in 161 msec 2023-02-12 03:03:49,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 03:03:49,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=14791f61f4a4d2190a519f0067b265f5, UNASSIGN in 167 msec 2023-02-12 03:03:49,090 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171029090"}]},"ts":"1676171029090"} 2023-02-12 03:03:49,092 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-12 03:03:49,093 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-12 03:03:49,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 179 msec 2023-02-12 03:03:49,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:03:49,223 INFO [Listener at localhost/43427] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-12 03:03:49,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,226 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,227 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:03:49,230 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:49,232 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2, FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/recovered.edits] 2023-02-12 03:03:49,236 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/7f9d1f8aa8e343a38559a571a2a02f3e to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/archive/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/7f9d1f8aa8e343a38559a571a2a02f3e 2023-02-12 03:03:49,237 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2 to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/archive/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f1/95c4279c24094d2d81fdb679a79f56a2 2023-02-12 03:03:49,240 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195 to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/archive/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/6f09e26ff3d14a4baced526d5ac7b195 2023-02-12 03:03:49,241 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/f60f4d9ff3004dceb46590695d030b2a to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/archive/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/f2/f60f4d9ff3004dceb46590695d030b2a 2023-02-12 03:03:49,244 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/recovered.edits/12.seqid to hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/archive/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5/recovered.edits/12.seqid 2023-02-12 03:03:49,244 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/.tmp/data/default/testInitTableSnapshotMapperJobConfig/14791f61f4a4d2190a519f0067b265f5 2023-02-12 03:03:49,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 03:03:49,246 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,249 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-12 03:03:49,251 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-12 03:03:49,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-12 03:03:49,252 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171029252"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:49,254 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 03:03:49,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 14791f61f4a4d2190a519f0067b265f5, NAME => 'testInitTableSnapshotMapperJobConfig,,1676171026579.14791f61f4a4d2190a519f0067b265f5.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 03:03:49,254 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-12 03:03:49,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171029254"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:49,257 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-12 03:03:49,259 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 03:03:49,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 35 msec 2023-02-12 03:03:49,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36949] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:03:49,329 INFO [Listener at localhost/43427] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-12 03:03:49,329 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:03:49,330 INFO [Listener at localhost/43427] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:03:49,330 DEBUG [Listener at localhost/43427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12bc598c to 127.0.0.1:55871 2023-02-12 03:03:49,330 DEBUG [Listener at localhost/43427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,330 DEBUG [Listener at localhost/43427] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:03:49,330 DEBUG [Listener at localhost/43427] util.JVMClusterUtil(257): Found active master hash=753466342, stopped=false 2023-02-12 03:03:49,330 INFO [Listener at localhost/43427] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:49,333 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:49,333 INFO [Listener at localhost/43427] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:03:49,333 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:49,333 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:49,335 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:49,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:49,335 DEBUG [Listener at localhost/43427] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0aa8780e to 127.0.0.1:55871 2023-02-12 03:03:49,335 DEBUG [Listener at localhost/43427] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:49,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:49,335 INFO [Listener at localhost/43427] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44503,1676171025400' ***** 2023-02-12 03:03:49,336 INFO [Listener at localhost/43427] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:49,336 INFO [Listener at localhost/43427] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,36463,1676171025433' ***** 2023-02-12 03:03:49,336 INFO [Listener at localhost/43427] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:49,336 INFO [RS:1;jenkins-hbase6:36463] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:49,336 INFO [RS:0;jenkins-hbase6:44503] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:49,336 INFO [RS:1;jenkins-hbase6:36463] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:49,336 INFO [RS:0;jenkins-hbase6:44503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:49,336 INFO [RS:1;jenkins-hbase6:36463] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:49,336 INFO [RS:0;jenkins-hbase6:44503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:49,337 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:49,337 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(3304): Received CLOSE for e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:49,336 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:49,336 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:49,338 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:49,339 DEBUG [RS:0;jenkins-hbase6:44503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e46c372 to 127.0.0.1:55871 2023-02-12 03:03:49,338 DEBUG [RS:1;jenkins-hbase6:36463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12bf159b to 127.0.0.1:55871 2023-02-12 03:03:49,340 DEBUG [RS:1;jenkins-hbase6:36463] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,340 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,36463,1676171025433; all regions closed. 2023-02-12 03:03:49,340 DEBUG [RS:0;jenkins-hbase6:44503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing e4bbabd552d27442eb22f9975c2bb6ee, disabling compactions & flushes 2023-02-12 03:03:49,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:49,342 INFO [RS:0;jenkins-hbase6:44503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:49,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:49,342 INFO [RS:0;jenkins-hbase6:44503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:49,342 INFO [RS:0;jenkins-hbase6:44503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:49,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. after waiting 0 ms 2023-02-12 03:03:49,342 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:03:49,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:49,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing e4bbabd552d27442eb22f9975c2bb6ee 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:03:49,346 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 03:03:49,346 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1479): Online Regions={e4bbabd552d27442eb22f9975c2bb6ee=hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 03:03:49,347 DEBUG [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1505): Waiting on 1588230740, e4bbabd552d27442eb22f9975c2bb6ee 2023-02-12 03:03:49,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:49,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:49,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:49,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:49,355 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:49,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-12 03:03:49,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/.tmp/info/0184c152b514401cb58dd66a726608ea 2023-02-12 03:03:49,365 DEBUG [RS:1;jenkins-hbase6:36463] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs 2023-02-12 03:03:49,365 INFO [RS:1;jenkins-hbase6:36463] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C36463%2C1676171025433:(num 1676171026740) 2023-02-12 03:03:49,365 DEBUG [RS:1;jenkins-hbase6:36463] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,365 INFO [RS:1;jenkins-hbase6:36463] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:49,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/.tmp/info/0184c152b514401cb58dd66a726608ea as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/info/0184c152b514401cb58dd66a726608ea 2023-02-12 03:03:49,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/info/0184c152b514401cb58dd66a726608ea, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:03:49,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e4bbabd552d27442eb22f9975c2bb6ee in 33ms, sequenceid=6, compaction requested=false 2023-02-12 03:03:49,375 INFO [RS:1;jenkins-hbase6:36463] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:49,375 INFO [RS:1;jenkins-hbase6:36463] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:49,375 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:49,375 INFO [RS:1;jenkins-hbase6:36463] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:49,375 INFO [RS:1;jenkins-hbase6:36463] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:49,376 INFO [RS:1;jenkins-hbase6:36463] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:36463 2023-02-12 03:03:49,380 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:49,380 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:49,380 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,36463,1676171025433 2023-02-12 03:03:49,380 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:49,380 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:49,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/namespace/e4bbabd552d27442eb22f9975c2bb6ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:03:49,380 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ea6495c rejected from java.util.concurrent.ThreadPoolExecutor@3a99da50[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:49,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:49,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for e4bbabd552d27442eb22f9975c2bb6ee: Waiting for close lock at 1676171029339Running coprocessor pre-close hooks at 1676171029339Disabling compacts and flushes for region at 1676171029339Disabling writes for close at 1676171029342 (+3 ms)Obtaining lock to block concurrent updates at 1676171029342Preparing flush snapshotting stores in e4bbabd552d27442eb22f9975c2bb6ee at 1676171029342Finished memstore snapshotting hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171029343 (+1 ms)Flushing stores of hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. at 1676171029346 (+3 ms)Flushing e4bbabd552d27442eb22f9975c2bb6ee/info: creating writer at 1676171029346Flushing e4bbabd552d27442eb22f9975c2bb6ee/info: appending metadata at 1676171029349 (+3 ms)Flushing e4bbabd552d27442eb22f9975c2bb6ee/info: closing flushed file at 1676171029349Flushing e4bbabd552d27442eb22f9975c2bb6ee/info: reopening flushed file at 1676171029370 (+21 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e4bbabd552d27442eb22f9975c2bb6ee in 33ms, sequenceid=6, compaction requested=false at 1676171029375 (+5 ms)Writing region close event to WAL at 1676171029376 (+1 ms)Running coprocessor post-close hooks at 1676171029380 (+4 ms)Closed at 1676171029381 (+1 ms) 2023-02-12 03:03:49,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171026022.e4bbabd552d27442eb22f9975c2bb6ee. 2023-02-12 03:03:49,381 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,36463,1676171025433] 2023-02-12 03:03:49,381 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,36463,1676171025433; numProcessing=1 2023-02-12 03:03:49,382 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,36463,1676171025433 already deleted, retry=false 2023-02-12 03:03:49,382 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,36463,1676171025433 expired; onlineServers=1 2023-02-12 03:03:49,384 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/info/6afcb3ca63aa44bcbfebaadb813eee05 2023-02-12 03:03:49,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6afcb3ca63aa44bcbfebaadb813eee05 2023-02-12 03:03:49,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/rep_barrier/24d9d8ab09cc4c04a7519284075bf711 2023-02-12 03:03:49,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24d9d8ab09cc4c04a7519284075bf711 2023-02-12 03:03:49,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/table/3958306ee26b4a1198fc3518fcd63a58 2023-02-12 03:03:49,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3958306ee26b4a1198fc3518fcd63a58 2023-02-12 03:03:49,418 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:49,419 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:49,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/info/6afcb3ca63aa44bcbfebaadb813eee05 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/info/6afcb3ca63aa44bcbfebaadb813eee05 2023-02-12 03:03:49,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6afcb3ca63aa44bcbfebaadb813eee05 2023-02-12 03:03:49,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/info/6afcb3ca63aa44bcbfebaadb813eee05, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 03:03:49,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/rep_barrier/24d9d8ab09cc4c04a7519284075bf711 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/rep_barrier/24d9d8ab09cc4c04a7519284075bf711 2023-02-12 03:03:49,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24d9d8ab09cc4c04a7519284075bf711 2023-02-12 03:03:49,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/rep_barrier/24d9d8ab09cc4c04a7519284075bf711, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:03:49,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/.tmp/table/3958306ee26b4a1198fc3518fcd63a58 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/table/3958306ee26b4a1198fc3518fcd63a58 2023-02-12 03:03:49,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3958306ee26b4a1198fc3518fcd63a58 2023-02-12 03:03:49,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/table/3958306ee26b4a1198fc3518fcd63a58, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 03:03:49,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 83ms, sequenceid=21, compaction requested=false 2023-02-12 03:03:49,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 03:03:49,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:49,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:49,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171029347Running coprocessor pre-close hooks at 1676171029347Disabling compacts and flushes for region at 1676171029347Disabling writes for close at 1676171029355 (+8 ms)Obtaining lock to block concurrent updates at 1676171029356 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676171029356Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676171029356Flushing stores of hbase:meta,,1.1588230740 at 1676171029356Flushing 1588230740/info: creating writer at 1676171029357 (+1 ms)Flushing 1588230740/info: appending metadata at 1676171029375 (+18 ms)Flushing 1588230740/info: closing flushed file at 1676171029375Flushing 1588230740/rep_barrier: creating writer at 1676171029389 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171029391 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171029391Flushing 1588230740/table: creating writer at 1676171029400 (+9 ms)Flushing 1588230740/table: appending metadata at 1676171029402 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676171029402Flushing 1588230740/info: reopening flushed file at 1676171029421 (+19 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171029427 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676171029432 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 83ms, sequenceid=21, compaction requested=false at 1676171029438 (+6 ms)Writing region close event to WAL at 1676171029440 (+2 ms)Running coprocessor post-close hooks at 1676171029445 (+5 ms)Closed at 1676171029445 2023-02-12 03:03:49,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:49,533 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:49,533 INFO [RS:1;jenkins-hbase6:36463] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,36463,1676171025433; zookeeper connection closed. 2023-02-12 03:03:49,533 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@424e0505 rejected from java.util.concurrent.ThreadPoolExecutor@3a99da50[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:49,533 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:36463-0x10154e94ff90002, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:49,533 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a114076 rejected from java.util.concurrent.ThreadPoolExecutor@3a99da50[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:49,533 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40fd84c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40fd84c6 2023-02-12 03:03:49,547 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44503,1676171025400; all regions closed. 2023-02-12 03:03:49,553 DEBUG [RS:0;jenkins-hbase6:44503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs 2023-02-12 03:03:49,553 INFO [RS:0;jenkins-hbase6:44503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44503%2C1676171025400.meta:.meta(num 1676171025960) 2023-02-12 03:03:49,559 DEBUG [RS:0;jenkins-hbase6:44503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/oldWALs 2023-02-12 03:03:49,559 INFO [RS:0;jenkins-hbase6:44503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44503%2C1676171025400:(num 1676171026377) 2023-02-12 03:03:49,559 DEBUG [RS:0;jenkins-hbase6:44503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,559 INFO [RS:0;jenkins-hbase6:44503] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:49,560 INFO [RS:0;jenkins-hbase6:44503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:49,560 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:49,561 INFO [RS:0;jenkins-hbase6:44503] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44503 2023-02-12 03:03:49,563 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44503,1676171025400 2023-02-12 03:03:49,563 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:49,563 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c09fb5a rejected from java.util.concurrent.ThreadPoolExecutor@28367a03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:49,563 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44503,1676171025400] 2023-02-12 03:03:49,563 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44503,1676171025400; numProcessing=2 2023-02-12 03:03:49,566 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44503,1676171025400 already deleted, retry=false 2023-02-12 03:03:49,566 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44503,1676171025400 expired; onlineServers=0 2023-02-12 03:03:49,566 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,36949,1676171025354' ***** 2023-02-12 03:03:49,566 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:03:49,567 DEBUG [M:0;jenkins-hbase6:36949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d77aa3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:49,567 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,36949,1676171025354 2023-02-12 03:03:49,567 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,36949,1676171025354; all regions closed. 2023-02-12 03:03:49,567 DEBUG [M:0;jenkins-hbase6:36949] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:49,567 DEBUG [M:0;jenkins-hbase6:36949] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:03:49,567 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:03:49,567 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171025604] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171025604,5,FailOnTimeoutGroup] 2023-02-12 03:03:49,567 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171025604] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171025604,5,FailOnTimeoutGroup] 2023-02-12 03:03:49,567 DEBUG [M:0;jenkins-hbase6:36949] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:03:49,569 INFO [M:0;jenkins-hbase6:36949] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:03:49,569 INFO [M:0;jenkins-hbase6:36949] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:03:49,569 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:49,569 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:49,569 INFO [M:0;jenkins-hbase6:36949] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:03:49,569 DEBUG [M:0;jenkins-hbase6:36949] master.HMaster(1502): Stopping service threads 2023-02-12 03:03:49,569 INFO [M:0;jenkins-hbase6:36949] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:03:49,570 ERROR [M:0;jenkins-hbase6:36949] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:03:49,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:49,570 INFO [M:0;jenkins-hbase6:36949] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:03:49,570 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:03:49,570 DEBUG [M:0;jenkins-hbase6:36949] zookeeper.ZKUtil(398): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:03:49,570 WARN [M:0;jenkins-hbase6:36949] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:03:49,570 INFO [M:0;jenkins-hbase6:36949] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:03:49,571 INFO [M:0;jenkins-hbase6:36949] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:03:49,571 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:49,571 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:49,571 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:49,571 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:49,571 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:49,571 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.90 KB heapSize=66.84 KB 2023-02-12 03:03:49,589 INFO [M:0;jenkins-hbase6:36949] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.90 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb038b4e73524c88b3d93651e8d83d84 2023-02-12 03:03:49,593 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb038b4e73524c88b3d93651e8d83d84 as hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb038b4e73524c88b3d93651e8d83d84 2023-02-12 03:03:49,598 INFO [M:0;jenkins-hbase6:36949] regionserver.HStore(1080): Added hdfs://localhost:33191/user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb038b4e73524c88b3d93651e8d83d84, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 03:03:49,598 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegion(2947): Finished flush of dataSize ~55.90 KB/57240, heapSize ~66.82 KB/68424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=132, compaction requested=false 2023-02-12 03:03:49,599 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:49,599 DEBUG [M:0;jenkins-hbase6:36949] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171029571Disabling compacts and flushes for region at 1676171029571Disabling writes for close at 1676171029571Obtaining lock to block concurrent updates at 1676171029571Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171029571Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57240, getHeapSize=68424, getOffHeapSize=0, getCellsCount=145 at 1676171029572 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171029572Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171029573 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171029575 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171029575Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171029594 (+19 ms)Finished flush of dataSize ~55.90 KB/57240, heapSize ~66.82 KB/68424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 27ms, sequenceid=132, compaction requested=false at 1676171029599 (+5 ms)Writing region close event to WAL at 1676171029599Closed at 1676171029599 2023-02-12 03:03:49,602 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/6e6b208e-1235-1d40-f5e6-598f624e5c7b/MasterData/WALs/jenkins-hbase6.apache.org,36949,1676171025354/jenkins-hbase6.apache.org%2C36949%2C1676171025354.1676171025522 not finished, retry = 0 2023-02-12 03:03:49,703 INFO [M:0;jenkins-hbase6:36949] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:03:49,703 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:49,705 INFO [M:0;jenkins-hbase6:36949] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:36949 2023-02-12 03:03:49,707 DEBUG [M:0;jenkins-hbase6:36949] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,36949,1676171025354 already deleted, retry=false 2023-02-12 03:03:49,876 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:49,936 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:49,936 INFO [M:0;jenkins-hbase6:36949] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,36949,1676171025354; zookeeper connection closed. 2023-02-12 03:03:49,936 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62b4ff96 rejected from java.util.concurrent.ThreadPoolExecutor@668b7718[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:49,937 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): master:36949-0x10154e94ff90000, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:49,937 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@576d3de8 rejected from java.util.concurrent.ThreadPoolExecutor@668b7718[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:50,036 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:50,036 INFO [RS:0;jenkins-hbase6:44503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44503,1676171025400; zookeeper connection closed. 2023-02-12 03:03:50,036 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fa3303d rejected from java.util.concurrent.ThreadPoolExecutor@28367a03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:50,036 DEBUG [Listener at localhost/43427-EventThread] zookeeper.ZKWatcher(600): regionserver:44503-0x10154e94ff90001, quorum=127.0.0.1:55871, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:50,036 ERROR [Listener at localhost/43427-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@476e405b rejected from java.util.concurrent.ThreadPoolExecutor@28367a03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:50,036 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3925db91] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3925db91 2023-02-12 03:03:50,037 INFO [Listener at localhost/43427] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:03:50,037 WARN [Listener at localhost/43427] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:50,054 INFO [Listener at localhost/43427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:50,159 WARN [BP-595812609-172.31.2.20-1676171024554 heartbeating to localhost/127.0.0.1:33191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:50,159 WARN [BP-595812609-172.31.2.20-1676171024554 heartbeating to localhost/127.0.0.1:33191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-595812609-172.31.2.20-1676171024554 (Datanode Uuid 4f20378c-da55-48e8-8bf9-4f022c19ff1a) service to localhost/127.0.0.1:33191 2023-02-12 03:03:50,160 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/dfs/data/data3/current/BP-595812609-172.31.2.20-1676171024554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:50,160 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/dfs/data/data4/current/BP-595812609-172.31.2.20-1676171024554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:50,162 WARN [Listener at localhost/43427] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:50,165 INFO [Listener at localhost/43427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:50,269 WARN [BP-595812609-172.31.2.20-1676171024554 heartbeating to localhost/127.0.0.1:33191] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:50,269 WARN [BP-595812609-172.31.2.20-1676171024554 heartbeating to localhost/127.0.0.1:33191] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-595812609-172.31.2.20-1676171024554 (Datanode Uuid 142ab8ba-1108-41cc-a939-9f46fa1b181a) service to localhost/127.0.0.1:33191 2023-02-12 03:03:50,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/dfs/data/data1/current/BP-595812609-172.31.2.20-1676171024554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:50,270 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/cluster_379b8226-87e4-7c1f-a7d1-d678e35368fd/dfs/data/data2/current/BP-595812609-172.31.2.20-1676171024554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:50,282 INFO [Listener at localhost/43427] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:50,395 INFO [Listener at localhost/43427] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:03:50,417 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:03:50,429 INFO [Listener at localhost/43427] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=181 (was 154) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:33191 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:33191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:33191 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:33191 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:33191 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:33191 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43427 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,36949,1676171025354)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=570 (was 537) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5453 (was 5499) 2023-02-12 03:03:50,439 INFO [Listener at localhost/43427] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=181, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=167, AvailableMemoryMB=5452 2023-02-12 03:03:50,449 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.log.dir so I do NOT create it in target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f 2023-02-12 03:03:50,450 WARN [Listener at localhost/43427] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.tmp.dir so I do NOT create it in target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f 2023-02-12 03:03:50,450 WARN [Listener at localhost/43427] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc2532fa-f8e3-e06f-bd6d-e158f1f8f9f6/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:03:50,450 DEBUG [Listener at localhost/43427] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb, deleteOnExit=true 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/test.cache.data in system properties and HBase conf 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:03:50,450 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:03:50,451 DEBUG [Listener at localhost/43427] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:03:50,451 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:03:50,452 INFO [Listener at localhost/43427] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:03:50,456 WARN [Listener at localhost/43427] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:50,456 WARN [Listener at localhost/43427] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:50,496 WARN [Listener at localhost/43427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:50,498 INFO [Listener at localhost/43427] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:50,502 INFO [Listener at localhost/43427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/java.io.tmpdir/Jetty_localhost_45061_hdfs____5u42no/webapp 2023-02-12 03:03:50,599 INFO [Listener at localhost/43427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45061 2023-02-12 03:03:50,603 WARN [Listener at localhost/43427] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:50,604 WARN [Listener at localhost/43427] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:50,647 WARN [Listener at localhost/41745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:50,663 WARN [Listener at localhost/41745] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:50,665 WARN [Listener at localhost/41745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:50,666 INFO [Listener at localhost/41745] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:50,670 INFO [Listener at localhost/41745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/java.io.tmpdir/Jetty_localhost_42633_datanode____z6apbz/webapp 2023-02-12 03:03:50,763 INFO [Listener at localhost/41745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42633 2023-02-12 03:03:50,770 WARN [Listener at localhost/45747] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:50,795 WARN [Listener at localhost/45747] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:50,797 WARN [Listener at localhost/45747] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:50,798 INFO [Listener at localhost/45747] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:50,803 INFO [Listener at localhost/45747] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/java.io.tmpdir/Jetty_localhost_42635_datanode____pgxewx/webapp 2023-02-12 03:03:50,882 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44800c3c79019585: Processing first storage report for DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7 from datanode 4c1c50d5-e8a5-4a6d-825c-1eb2b0af0202 2023-02-12 03:03:50,882 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44800c3c79019585: from storage DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7 node DatanodeRegistration(127.0.0.1:41615, datanodeUuid=4c1c50d5-e8a5-4a6d-825c-1eb2b0af0202, infoPort=38183, infoSecurePort=0, ipcPort=45747, storageInfo=lv=-57;cid=testClusterID;nsid=712353692;c=1676171030459), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:50,882 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x44800c3c79019585: Processing first storage report for DS-f063009d-93a9-4fb3-9791-f28cdcafd1ad from datanode 4c1c50d5-e8a5-4a6d-825c-1eb2b0af0202 2023-02-12 03:03:50,882 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x44800c3c79019585: from storage DS-f063009d-93a9-4fb3-9791-f28cdcafd1ad node DatanodeRegistration(127.0.0.1:41615, datanodeUuid=4c1c50d5-e8a5-4a6d-825c-1eb2b0af0202, infoPort=38183, infoSecurePort=0, ipcPort=45747, storageInfo=lv=-57;cid=testClusterID;nsid=712353692;c=1676171030459), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:50,900 INFO [Listener at localhost/45747] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42635 2023-02-12 03:03:50,908 WARN [Listener at localhost/36779] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:51,015 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e5ac54a0868951f: Processing first storage report for DS-df87b553-a35b-4877-8d7e-01b54b2c483d from datanode ddf2c6b2-08bd-4987-97a7-1352732c3b30 2023-02-12 03:03:51,015 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e5ac54a0868951f: from storage DS-df87b553-a35b-4877-8d7e-01b54b2c483d node DatanodeRegistration(127.0.0.1:33111, datanodeUuid=ddf2c6b2-08bd-4987-97a7-1352732c3b30, infoPort=43915, infoSecurePort=0, ipcPort=36779, storageInfo=lv=-57;cid=testClusterID;nsid=712353692;c=1676171030459), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:51,015 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8e5ac54a0868951f: Processing first storage report for DS-eb2b1dbf-c3d4-4120-b591-ffaf7241a78f from datanode ddf2c6b2-08bd-4987-97a7-1352732c3b30 2023-02-12 03:03:51,015 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8e5ac54a0868951f: from storage DS-eb2b1dbf-c3d4-4120-b591-ffaf7241a78f node DatanodeRegistration(127.0.0.1:33111, datanodeUuid=ddf2c6b2-08bd-4987-97a7-1352732c3b30, infoPort=43915, infoSecurePort=0, ipcPort=36779, storageInfo=lv=-57;cid=testClusterID;nsid=712353692;c=1676171030459), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:51,020 DEBUG [Listener at localhost/36779] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f 2023-02-12 03:03:51,022 INFO [Listener at localhost/36779] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/zookeeper_0, clientPort=55495, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:03:51,023 INFO [Listener at localhost/36779] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55495 2023-02-12 03:03:51,023 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,024 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,039 INFO [Listener at localhost/36779] util.FSUtils(479): Created version file at hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b with version=8 2023-02-12 03:03:51,039 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,040 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,041 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/hbase-staging 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:51,043 INFO [Listener at localhost/36779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:51,044 INFO [Listener at localhost/36779] ipc.NettyRpcServer(120): Bind to /172.31.2.20:40971 2023-02-12 03:03:51,044 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,045 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,046 INFO [Listener at localhost/36779] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40971 connecting to ZooKeeper ensemble=127.0.0.1:55495 2023-02-12 03:03:51,053 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:409710x0, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:51,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40971-0x10154e966320000 connected 2023-02-12 03:03:51,068 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:51,069 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:51,069 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:51,070 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40971 2023-02-12 03:03:51,070 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40971 2023-02-12 03:03:51,071 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40971 2023-02-12 03:03:51,071 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40971 2023-02-12 03:03:51,071 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40971 2023-02-12 03:03:51,071 INFO [Listener at localhost/36779] master.HMaster(439): hbase.rootdir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b, hbase.cluster.distributed=false 2023-02-12 03:03:51,086 INFO [Listener at localhost/36779] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:51,086 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,087 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,087 INFO [Listener at localhost/36779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:51,087 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,087 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:51,087 INFO [Listener at localhost/36779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:51,088 INFO [Listener at localhost/36779] ipc.NettyRpcServer(120): Bind to /172.31.2.20:38635 2023-02-12 03:03:51,088 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:51,091 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:51,092 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,092 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,093 INFO [Listener at localhost/36779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38635 connecting to ZooKeeper ensemble=127.0.0.1:55495 2023-02-12 03:03:51,097 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:386350x0, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:51,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38635-0x10154e966320001 connected 2023-02-12 03:03:51,098 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:51,099 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:51,099 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:51,102 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-12 03:03:51,103 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38635 2023-02-12 03:03:51,103 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38635 2023-02-12 03:03:51,106 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-12 03:03:51,106 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38635 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:51,118 INFO [Listener at localhost/36779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:51,119 INFO [Listener at localhost/36779] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46453 2023-02-12 03:03:51,120 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:51,121 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:51,121 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,122 INFO [Listener at localhost/36779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,123 INFO [Listener at localhost/36779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46453 connecting to ZooKeeper ensemble=127.0.0.1:55495 2023-02-12 03:03:51,129 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:464530x0, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:51,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46453-0x10154e966320002 connected 2023-02-12 03:03:51,130 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:51,131 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:51,131 DEBUG [Listener at localhost/36779] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:51,134 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46453 2023-02-12 03:03:51,135 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46453 2023-02-12 03:03:51,135 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46453 2023-02-12 03:03:51,135 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46453 2023-02-12 03:03:51,137 DEBUG [Listener at localhost/36779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46453 2023-02-12 03:03:51,139 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,140 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:51,140 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,142 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:51,142 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:51,142 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,142 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:51,144 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:51,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:51,145 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,40971,1676171031042 from backup master directory 2023-02-12 03:03:51,146 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,146 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:51,146 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:51,147 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,162 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/hbase.id with ID: 8368cc89-c5c2-4e34-ae12-493b6d8fa96c 2023-02-12 03:03:51,172 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:51,176 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,183 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3e4a86de to 127.0.0.1:55495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:51,189 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@388cdac2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:51,189 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:51,189 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:03:51,190 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:51,192 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store-tmp 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:51,205 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:51,205 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:51,205 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171031205Disabling compacts and flushes for region at 1676171031205Disabling writes for close at 1676171031205Writing region close event to WAL at 1676171031205Closed at 1676171031205 2023-02-12 03:03:51,206 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/WALs/jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,208 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C40971%2C1676171031042, suffix=, logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/WALs/jenkins-hbase6.apache.org,40971,1676171031042, archiveDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/oldWALs, maxLogs=10 2023-02-12 03:03:51,223 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK] 2023-02-12 03:03:51,224 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK] 2023-02-12 03:03:51,226 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/WALs/jenkins-hbase6.apache.org,40971,1676171031042/jenkins-hbase6.apache.org%2C40971%2C1676171031042.1676171031209 2023-02-12 03:03:51,228 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK], DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK]] 2023-02-12 03:03:51,228 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:51,228 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:51,229 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,229 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,230 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,231 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:03:51,232 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:03:51,232 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,233 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,233 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,236 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:51,238 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:51,238 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71578215, jitterRate=0.06659851968288422}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:51,238 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171031229Initializing all the Stores at 1676171031230 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171031230Cleaning up temporary data from old regions at 1676171031234 (+4 ms)Cleaning up detritus from prior splits at 1676171031234Region opened successfully at 1676171031238 (+4 ms) 2023-02-12 03:03:51,242 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:03:51,244 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:03:51,247 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:03:51,247 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:03:51,258 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:03:51,258 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:03:51,258 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:03:51,258 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:03:51,259 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:03:51,261 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,261 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:03:51,261 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:03:51,262 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:03:51,264 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:51,264 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,264 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:51,264 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:51,266 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,40971,1676171031042, sessionid=0x10154e966320000, setting cluster-up flag (Was=false) 2023-02-12 03:03:51,271 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,275 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:03:51,276 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,279 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,285 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:03:51,286 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:51,287 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/.tmp 2023-02-12 03:03:51,288 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:51,289 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,291 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171061291 2023-02-12 03:03:51,291 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:03:51,292 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,292 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:03:51,293 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:03:51,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171031293,5,FailOnTimeoutGroup] 2023-02-12 03:03:51,293 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171031293,5,FailOnTimeoutGroup] 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:03:51,293 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,294 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,294 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:51,303 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:51,303 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:51,303 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b 2023-02-12 03:03:51,310 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:51,311 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:51,313 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/info 2023-02-12 03:03:51,313 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:51,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:51,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:51,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:51,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:51,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/table 2023-02-12 03:03:51,318 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:51,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,319 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740 2023-02-12 03:03:51,319 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740 2023-02-12 03:03:51,321 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:51,322 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:51,324 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58955249, jitterRate=-0.12149833142757416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171031310Initializing all the Stores at 1676171031311 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171031311Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171031311Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171031311Cleaning up temporary data from old regions at 1676171031320 (+9 ms)Cleaning up detritus from prior splits at 1676171031321 (+1 ms)Region opened successfully at 1676171031324 (+3 ms) 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:51,324 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:51,324 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:51,325 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:51,325 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171031324Disabling compacts and flushes for region at 1676171031324Disabling writes for close at 1676171031324Writing region close event to WAL at 1676171031325 (+1 ms)Closed at 1676171031325 2023-02-12 03:03:51,325 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:51,325 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:03:51,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:03:51,327 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:03:51,329 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:03:51,339 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(952): ClusterId : 8368cc89-c5c2-4e34-ae12-493b6d8fa96c 2023-02-12 03:03:51,339 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(952): ClusterId : 8368cc89-c5c2-4e34-ae12-493b6d8fa96c 2023-02-12 03:03:51,339 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:51,339 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:51,341 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:51,341 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:51,341 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:51,341 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:51,343 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:51,343 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:51,345 DEBUG [RS:1;jenkins-hbase6:46453] zookeeper.ReadOnlyZKClient(139): Connect 0x147a0066 to 127.0.0.1:55495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:51,345 DEBUG [RS:0;jenkins-hbase6:38635] zookeeper.ReadOnlyZKClient(139): Connect 0x674e527b to 127.0.0.1:55495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:51,351 DEBUG [RS:1;jenkins-hbase6:46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1abdfc99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:51,351 DEBUG [RS:1;jenkins-hbase6:46453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e826b16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:51,351 DEBUG [RS:0;jenkins-hbase6:38635] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6989a0e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:51,352 DEBUG [RS:0;jenkins-hbase6:38635] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db6390b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:51,360 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:38635 2023-02-12 03:03:51,360 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:46453 2023-02-12 03:03:51,360 INFO [RS:0;jenkins-hbase6:38635] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:51,360 INFO [RS:0;jenkins-hbase6:38635] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:51,360 INFO [RS:1;jenkins-hbase6:46453] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:51,360 INFO [RS:1;jenkins-hbase6:46453] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:51,360 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:51,360 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:51,361 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40971,1676171031042 with isa=jenkins-hbase6.apache.org/172.31.2.20:46453, startcode=1676171031117 2023-02-12 03:03:51,361 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40971,1676171031042 with isa=jenkins-hbase6.apache.org/172.31.2.20:38635, startcode=1676171031086 2023-02-12 03:03:51,361 DEBUG [RS:1;jenkins-hbase6:46453] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:51,361 DEBUG [RS:0;jenkins-hbase6:38635] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:51,364 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37197, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:51,364 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53589, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:51,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40971] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,366 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b 2023-02-12 03:03:51,366 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b 2023-02-12 03:03:51,366 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41745 2023-02-12 03:03:51,366 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41745 2023-02-12 03:03:51,366 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:51,366 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:51,371 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:51,372 DEBUG [RS:0;jenkins-hbase6:38635] zookeeper.ZKUtil(162): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,372 WARN [RS:0;jenkins-hbase6:38635] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:51,372 DEBUG [RS:1;jenkins-hbase6:46453] zookeeper.ZKUtil(162): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,372 INFO [RS:0;jenkins-hbase6:38635] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:51,372 WARN [RS:1;jenkins-hbase6:46453] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:51,372 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,372 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,46453,1676171031117] 2023-02-12 03:03:51,372 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,38635,1676171031086] 2023-02-12 03:03:51,372 INFO [RS:1;jenkins-hbase6:46453] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:51,372 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,382 DEBUG [RS:0;jenkins-hbase6:38635] zookeeper.ZKUtil(162): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,382 DEBUG [RS:1;jenkins-hbase6:46453] zookeeper.ZKUtil(162): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,383 DEBUG [RS:0;jenkins-hbase6:38635] zookeeper.ZKUtil(162): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,383 DEBUG [RS:1;jenkins-hbase6:46453] zookeeper.ZKUtil(162): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,384 DEBUG [RS:0;jenkins-hbase6:38635] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:51,384 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:51,384 INFO [RS:0;jenkins-hbase6:38635] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:51,384 INFO [RS:1;jenkins-hbase6:46453] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:51,385 INFO [RS:0;jenkins-hbase6:38635] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:51,386 INFO [RS:0;jenkins-hbase6:38635] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:51,386 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,386 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:51,391 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,391 INFO [RS:1;jenkins-hbase6:46453] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 DEBUG [RS:0;jenkins-hbase6:38635] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,392 INFO [RS:1;jenkins-hbase6:46453] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:51,392 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,397 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:51,397 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,397 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,397 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,398 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,399 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:51,400 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,400 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,400 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,400 DEBUG [RS:1;jenkins-hbase6:46453] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:51,403 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,403 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,403 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,414 INFO [RS:1;jenkins-hbase6:46453] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:51,414 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46453,1676171031117-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,415 INFO [RS:0;jenkins-hbase6:38635] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:51,415 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38635,1676171031086-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,425 INFO [RS:1;jenkins-hbase6:46453] regionserver.Replication(203): jenkins-hbase6.apache.org,46453,1676171031117 started 2023-02-12 03:03:51,425 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,46453,1676171031117, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:46453, sessionid=0x10154e966320002 2023-02-12 03:03:51,425 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:51,425 DEBUG [RS:1;jenkins-hbase6:46453] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,425 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46453,1676171031117' 2023-02-12 03:03:51,425 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:51,425 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46453,1676171031117' 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:51,426 DEBUG [RS:1;jenkins-hbase6:46453] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:51,426 INFO [RS:1;jenkins-hbase6:46453] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:51,426 INFO [RS:1;jenkins-hbase6:46453] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:51,433 INFO [RS:0;jenkins-hbase6:38635] regionserver.Replication(203): jenkins-hbase6.apache.org,38635,1676171031086 started 2023-02-12 03:03:51,433 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,38635,1676171031086, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:38635, sessionid=0x10154e966320001 2023-02-12 03:03:51,433 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:51,433 DEBUG [RS:0;jenkins-hbase6:38635] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,433 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,38635,1676171031086' 2023-02-12 03:03:51,433 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,38635,1676171031086' 2023-02-12 03:03:51,434 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:51,435 DEBUG [RS:0;jenkins-hbase6:38635] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:51,435 DEBUG [RS:0;jenkins-hbase6:38635] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:51,435 INFO [RS:0;jenkins-hbase6:38635] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:51,435 INFO [RS:0;jenkins-hbase6:38635] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:51,479 DEBUG [jenkins-hbase6:40971] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:03:51,479 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:03:51,479 DEBUG [jenkins-hbase6:40971] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:51,482 DEBUG [jenkins-hbase6:40971] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:51,482 DEBUG [jenkins-hbase6:40971] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:51,482 DEBUG [jenkins-hbase6:40971] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:51,483 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46453,1676171031117, state=OPENING 2023-02-12 03:03:51,489 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:03:51,490 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:51,491 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:51,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:51,647 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,647 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:51,649 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45838, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:51,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:03:51,653 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:51,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46453%2C1676171031117.meta, suffix=.meta, logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,46453,1676171031117, archiveDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs, maxLogs=32 2023-02-12 03:03:51,673 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK] 2023-02-12 03:03:51,673 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK] 2023-02-12 03:03:51,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,46453,1676171031117/jenkins-hbase6.apache.org%2C46453%2C1676171031117.meta.1676171031656.meta 2023-02-12 03:03:51,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK], DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK]] 2023-02-12 03:03:51,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:51,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:03:51,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:03:51,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:03:51,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:03:51,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:51,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:03:51,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:03:51,677 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:51,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/info 2023-02-12 03:03:51,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/info 2023-02-12 03:03:51,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:51,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:51,680 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:51,680 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:51,681 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:51,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:51,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/table 2023-02-12 03:03:51,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/table 2023-02-12 03:03:51,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:51,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:51,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740 2023-02-12 03:03:51,686 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740 2023-02-12 03:03:51,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:51,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:51,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64605639, jitterRate=-0.0373009592294693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:51,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171031676Writing region info on filesystem at 1676171031676Initializing all the Stores at 1676171031677 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171031677Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171031677Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171031677Cleaning up temporary data from old regions at 1676171031687 (+10 ms)Cleaning up detritus from prior splits at 1676171031687Running coprocessor post-open hooks at 1676171031690 (+3 ms)Region opened successfully at 1676171031690 2023-02-12 03:03:51,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171031647 2023-02-12 03:03:51,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:03:51,696 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:03:51,697 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46453,1676171031117, state=OPEN 2023-02-12 03:03:51,698 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:03:51,698 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:51,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:03:51,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46453,1676171031117 in 207 msec 2023-02-12 03:03:51,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:03:51,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 375 msec 2023-02-12 03:03:51,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 415 msec 2023-02-12 03:03:51,703 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171031140, completionTime=-1 2023-02-12 03:03:51,703 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:03:51,703 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:03:51,706 DEBUG [hconnection-0x20baf3bb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:51,708 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45844, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:51,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:03:51,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171091710 2023-02-12 03:03:51,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171151710 2023-02-12 03:03:51,710 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40971,1676171031042-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40971,1676171031042-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40971,1676171031042-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:40971, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:03:51,719 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:51,720 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:03:51,722 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:03:51,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:51,723 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:51,724 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:51,725 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2 empty. 2023-02-12 03:03:51,725 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:51,725 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:03:51,746 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:51,747 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => de5599041d57a9fc9513baf36d31bfb2, NAME => 'hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:51,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:51,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing de5599041d57a9fc9513baf36d31bfb2, disabling compactions & flushes 2023-02-12 03:03:51,757 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:51,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:51,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. after waiting 0 ms 2023-02-12 03:03:51,757 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:51,757 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:51,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for de5599041d57a9fc9513baf36d31bfb2: Waiting for close lock at 1676171031757Disabling compacts and flushes for region at 1676171031757Disabling writes for close at 1676171031757Writing region close event to WAL at 1676171031757Closed at 1676171031757 2023-02-12 03:03:51,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:51,761 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171031761"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171031761"}]},"ts":"1676171031761"} 2023-02-12 03:03:51,764 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:51,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:51,765 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171031765"}]},"ts":"1676171031765"} 2023-02-12 03:03:51,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:03:51,770 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:51,770 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:51,770 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:51,771 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:51,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=de5599041d57a9fc9513baf36d31bfb2, ASSIGN}] 2023-02-12 03:03:51,775 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=de5599041d57a9fc9513baf36d31bfb2, ASSIGN 2023-02-12 03:03:51,777 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=de5599041d57a9fc9513baf36d31bfb2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:51,927 INFO [jenkins-hbase6:40971] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:51,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=de5599041d57a9fc9513baf36d31bfb2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:51,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171031928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171031928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171031928"}]},"ts":"1676171031928"} 2023-02-12 03:03:51,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure de5599041d57a9fc9513baf36d31bfb2, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:52,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46453%2C1676171031117, suffix=, logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,46453,1676171031117, archiveDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs, maxLogs=32 2023-02-12 03:03:52,102 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK] 2023-02-12 03:03:52,102 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK] 2023-02-12 03:03:52,104 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,46453,1676171031117/jenkins-hbase6.apache.org%2C46453%2C1676171031117.1676171032088 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK], DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK]] 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de5599041d57a9fc9513baf36d31bfb2, NAME => 'hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,106 INFO [StoreOpener-de5599041d57a9fc9513baf36d31bfb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,107 DEBUG [StoreOpener-de5599041d57a9fc9513baf36d31bfb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/info 2023-02-12 03:03:52,107 DEBUG [StoreOpener-de5599041d57a9fc9513baf36d31bfb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/info 2023-02-12 03:03:52,107 INFO [StoreOpener-de5599041d57a9fc9513baf36d31bfb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de5599041d57a9fc9513baf36d31bfb2 columnFamilyName info 2023-02-12 03:03:52,108 INFO [StoreOpener-de5599041d57a9fc9513baf36d31bfb2-1] regionserver.HStore(310): Store=de5599041d57a9fc9513baf36d31bfb2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,111 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:52,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,113 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened de5599041d57a9fc9513baf36d31bfb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67961129, jitterRate=0.012699738144874573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:52,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for de5599041d57a9fc9513baf36d31bfb2: Running coprocessor pre-open hook at 1676171032105Writing region info on filesystem at 1676171032105Initializing all the Stores at 1676171032105Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171032105Cleaning up temporary data from old regions at 1676171032109 (+4 ms)Cleaning up detritus from prior splits at 1676171032110 (+1 ms)Running coprocessor post-open hooks at 1676171032113 (+3 ms)Region opened successfully at 1676171032113 2023-02-12 03:03:52,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2., pid=6, masterSystemTime=1676171032083 2023-02-12 03:03:52,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:52,117 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:52,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=de5599041d57a9fc9513baf36d31bfb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,117 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171032117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032117"}]},"ts":"1676171032117"} 2023-02-12 03:03:52,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:03:52,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure de5599041d57a9fc9513baf36d31bfb2, server=jenkins-hbase6.apache.org,46453,1676171031117 in 189 msec 2023-02-12 03:03:52,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:03:52,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=de5599041d57a9fc9513baf36d31bfb2, ASSIGN in 350 msec 2023-02-12 03:03:52,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:52,123 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171032123"}]},"ts":"1676171032123"} 2023-02-12 03:03:52,125 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:03:52,127 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:52,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 408 msec 2023-02-12 03:03:52,222 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:03:52,224 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:52,224 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:52,228 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:03:52,235 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:52,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 03:03:52,239 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:03:52,246 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:52,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 03:03:52,253 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:03:52,257 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:03:52,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.110sec 2023-02-12 03:03:52,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:03:52,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:03:52,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:03:52,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40971,1676171031042-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:03:52,258 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40971,1676171031042-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:03:52,259 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:03:52,340 DEBUG [Listener at localhost/36779] zookeeper.ReadOnlyZKClient(139): Connect 0x464291b2 to 127.0.0.1:55495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:52,345 DEBUG [Listener at localhost/36779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@529fd38b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:52,346 DEBUG [hconnection-0x78e0b87-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:52,348 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:52,350 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:52,350 DEBUG [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:03:52,351 DEBUG [Listener at localhost/36779] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:03:52,353 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43090, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:03:52,353 INFO [Listener at localhost/36779] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 03:03:52,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceMultiRegion 2023-02-12 03:03:52,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:03:52,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.20:43090 deadline: 1676171092354, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-12 03:03:52,354 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-12 03:03:52,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:52,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:52,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-12 03:03:52,360 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:52,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c empty. 2023-02-12 03:03:52,367 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 empty. 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,368 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d empty. 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d empty. 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b empty. 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,369 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,369 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 03:03:52,378 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:52,380 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => fdeccfa6da1f207cd7d7ef859596ca0c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,380 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5256588c4e46c1ac77683a07b572a85d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,380 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4866d0a2e16b4444f70021950fd29e1c, NAME => 'testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing fdeccfa6da1f207cd7d7ef859596ca0c, disabling compactions & flushes 2023-02-12 03:03:52,402 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. after waiting 0 ms 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,402 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for fdeccfa6da1f207cd7d7ef859596ca0c: Waiting for close lock at 1676171032402Disabling compacts and flushes for region at 1676171032402Disabling writes for close at 1676171032402Writing region close event to WAL at 1676171032402Closed at 1676171032402 2023-02-12 03:03:52,403 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => b38a5be7071bddacf354fee2d0f2e05d, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,405 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,405 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 4866d0a2e16b4444f70021950fd29e1c, disabling compactions & flushes 2023-02-12 03:03:52,405 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,405 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,405 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,405 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. after waiting 0 ms 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5256588c4e46c1ac77683a07b572a85d, disabling compactions & flushes 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,406 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,406 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 4866d0a2e16b4444f70021950fd29e1c: Waiting for close lock at 1676171032405Disabling compacts and flushes for region at 1676171032405Disabling writes for close at 1676171032406 (+1 ms)Writing region close event to WAL at 1676171032406Closed at 1676171032406 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. after waiting 0 ms 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,406 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,406 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5256588c4e46c1ac77683a07b572a85d: Waiting for close lock at 1676171032406Disabling compacts and flushes for region at 1676171032406Disabling writes for close at 1676171032406Writing region close event to WAL at 1676171032406Closed at 1676171032406 2023-02-12 03:03:52,406 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => cde8d98d3430cca9a5979706694ddc35, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,407 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5b0045e911fffda0ed4b1f5f6bd3bffe, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,417 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,418 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing b38a5be7071bddacf354fee2d0f2e05d, disabling compactions & flushes 2023-02-12 03:03:52,418 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,418 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,418 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. after waiting 0 ms 2023-02-12 03:03:52,418 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,418 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,418 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for b38a5be7071bddacf354fee2d0f2e05d: Waiting for close lock at 1676171032418Disabling compacts and flushes for region at 1676171032418Disabling writes for close at 1676171032418Writing region close event to WAL at 1676171032418Closed at 1676171032418 2023-02-12 03:03:52,418 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 10c16957f542d233830d97624ef0c296, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5b0045e911fffda0ed4b1f5f6bd3bffe, disabling compactions & flushes 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing cde8d98d3430cca9a5979706694ddc35, disabling compactions & flushes 2023-02-12 03:03:52,421 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,421 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,421 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. after waiting 0 ms 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. after waiting 0 ms 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,422 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,422 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Waiting for close lock at 1676171032421Disabling compacts and flushes for region at 1676171032421Disabling writes for close at 1676171032422 (+1 ms)Writing region close event to WAL at 1676171032422Closed at 1676171032422 2023-02-12 03:03:52,422 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for cde8d98d3430cca9a5979706694ddc35: Waiting for close lock at 1676171032421Disabling compacts and flushes for region at 1676171032421Disabling writes for close at 1676171032422 (+1 ms)Writing region close event to WAL at 1676171032422Closed at 1676171032422 2023-02-12 03:03:52,422 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 176457630362e278d018029d375948d6, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,423 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3b46456aa10812feb1bbc7b780ffcfa2, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 10c16957f542d233830d97624ef0c296, disabling compactions & flushes 2023-02-12 03:03:52,431 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. after waiting 0 ms 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,431 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,431 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 10c16957f542d233830d97624ef0c296: Waiting for close lock at 1676171032431Disabling compacts and flushes for region at 1676171032431Disabling writes for close at 1676171032431Writing region close event to WAL at 1676171032431Closed at 1676171032431 2023-02-12 03:03:52,432 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => c106a7e7ca705f10c3fedfdb7db9eb8b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp 2023-02-12 03:03:52,435 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,436 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 176457630362e278d018029d375948d6, disabling compactions & flushes 2023-02-12 03:03:52,436 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,436 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,436 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. after waiting 0 ms 2023-02-12 03:03:52,436 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,436 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,436 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 176457630362e278d018029d375948d6: Waiting for close lock at 1676171032436Disabling compacts and flushes for region at 1676171032436Disabling writes for close at 1676171032436Writing region close event to WAL at 1676171032436Closed at 1676171032436 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3b46456aa10812feb1bbc7b780ffcfa2, disabling compactions & flushes 2023-02-12 03:03:52,437 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. after waiting 0 ms 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,437 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,437 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3b46456aa10812feb1bbc7b780ffcfa2: Waiting for close lock at 1676171032437Disabling compacts and flushes for region at 1676171032437Disabling writes for close at 1676171032437Writing region close event to WAL at 1676171032437Closed at 1676171032437 2023-02-12 03:03:52,437 INFO [RS:0;jenkins-hbase6:38635] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C38635%2C1676171031086, suffix=, logDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,38635,1676171031086, archiveDir=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs, maxLogs=32 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing c106a7e7ca705f10c3fedfdb7db9eb8b, disabling compactions & flushes 2023-02-12 03:03:52,441 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. after waiting 0 ms 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,441 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,441 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Waiting for close lock at 1676171032441Disabling compacts and flushes for region at 1676171032441Disabling writes for close at 1676171032441Writing region close event to WAL at 1676171032441Closed at 1676171032441 2023-02-12 03:03:52,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171032444"}]},"ts":"1676171032444"} 2023-02-12 03:03:52,447 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 03:03:52,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:52,448 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171032448"}]},"ts":"1676171032448"} 2023-02-12 03:03:52,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-12 03:03:52,453 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:52,457 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK] 2023-02-12 03:03:52,457 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK] 2023-02-12 03:03:52,459 INFO [RS:0;jenkins-hbase6:38635] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/WALs/jenkins-hbase6.apache.org,38635,1676171031086/jenkins-hbase6.apache.org%2C38635%2C1676171031086.1676171032438 2023-02-12 03:03:52,460 DEBUG [RS:0;jenkins-hbase6:38635] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33111,DS-df87b553-a35b-4877-8d7e-01b54b2c483d,DISK], DatanodeInfoWithStorage[127.0.0.1:41615,DS-734a09ae-761b-4ff8-9a7c-b19b8cba4ae7,DISK]] 2023-02-12 03:03:52,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:52,462 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:52,462 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:52,462 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:52,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, ASSIGN}] 2023-02-12 03:03:52,464 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, ASSIGN 2023-02-12 03:03:52,464 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, ASSIGN 2023-02-12 03:03:52,464 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, ASSIGN 2023-02-12 03:03:52,465 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, ASSIGN 2023-02-12 03:03:52,465 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:52,465 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38635,1676171031086; forceNewPlan=false, retain=false 2023-02-12 03:03:52,466 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:52,466 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38635,1676171031086; forceNewPlan=false, retain=false 2023-02-12 03:03:52,466 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, ASSIGN 2023-02-12 03:03:52,466 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, ASSIGN 2023-02-12 03:03:52,466 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, ASSIGN 2023-02-12 03:03:52,466 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, ASSIGN 2023-02-12 03:03:52,467 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, ASSIGN 2023-02-12 03:03:52,467 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:52,467 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38635,1676171031086; forceNewPlan=false, retain=false 2023-02-12 03:03:52,467 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:52,467 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38635,1676171031086; forceNewPlan=false, retain=false 2023-02-12 03:03:52,468 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,38635,1676171031086; forceNewPlan=false, retain=false 2023-02-12 03:03:52,468 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, ASSIGN 2023-02-12 03:03:52,469 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46453,1676171031117; forceNewPlan=false, retain=false 2023-02-12 03:03:52,616 INFO [jenkins-hbase6:40971] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 03:03:52,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=176457630362e278d018029d375948d6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,622 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cde8d98d3430cca9a5979706694ddc35, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,622 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032622"}]},"ts":"1676171032622"} 2023-02-12 03:03:52,622 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b38a5be7071bddacf354fee2d0f2e05d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,622 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4866d0a2e16b4444f70021950fd29e1c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,622 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032622"}]},"ts":"1676171032622"} 2023-02-12 03:03:52,622 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c106a7e7ca705f10c3fedfdb7db9eb8b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,622 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032622"}]},"ts":"1676171032622"} 2023-02-12 03:03:52,623 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032622"}]},"ts":"1676171032622"} 2023-02-12 03:03:52,622 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032622"}]},"ts":"1676171032622"} 2023-02-12 03:03:52,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 176457630362e278d018029d375948d6, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure b38a5be7071bddacf354fee2d0f2e05d, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 4866d0a2e16b4444f70021950fd29e1c, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure cde8d98d3430cca9a5979706694ddc35, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure c106a7e7ca705f10c3fedfdb7db9eb8b, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:52,629 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5256588c4e46c1ac77683a07b572a85d, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5b0045e911fffda0ed4b1f5f6bd3bffe, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,629 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032629"}]},"ts":"1676171032629"} 2023-02-12 03:03:52,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032629"}]},"ts":"1676171032629"} 2023-02-12 03:03:52,631 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3b46456aa10812feb1bbc7b780ffcfa2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,631 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032631"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032631"}]},"ts":"1676171032631"} 2023-02-12 03:03:52,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure 5256588c4e46c1ac77683a07b572a85d, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:52,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 5b0045e911fffda0ed4b1f5f6bd3bffe, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:52,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 3b46456aa10812feb1bbc7b780ffcfa2, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:52,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fdeccfa6da1f207cd7d7ef859596ca0c, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032633"}]},"ts":"1676171032633"} 2023-02-12 03:03:52,633 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=10c16957f542d233830d97624ef0c296, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,633 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171032633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171032633"}]},"ts":"1676171032633"} 2023-02-12 03:03:52,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure fdeccfa6da1f207cd7d7ef859596ca0c, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:52,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 10c16957f542d233830d97624ef0c296, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:52,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:52,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4866d0a2e16b4444f70021950fd29e1c, NAME => 'testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 03:03:52,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,783 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,783 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,783 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:52,784 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f1 2023-02-12 03:03:52,785 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f1 2023-02-12 03:03:52,785 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:52,785 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4866d0a2e16b4444f70021950fd29e1c columnFamilyName f1 2023-02-12 03:03:52,785 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(310): Store=4866d0a2e16b4444f70021950fd29e1c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,786 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdeccfa6da1f207cd7d7ef859596ca0c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 03:03:52,788 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f2 2023-02-12 03:03:52,788 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f2 2023-02-12 03:03:52,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,788 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4866d0a2e16b4444f70021950fd29e1c columnFamilyName f2 2023-02-12 03:03:52,789 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(310): Store=4866d0a2e16b4444f70021950fd29e1c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,790 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,791 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1 2023-02-12 03:03:52,791 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1 2023-02-12 03:03:52,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,791 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdeccfa6da1f207cd7d7ef859596ca0c columnFamilyName f1 2023-02-12 03:03:52,792 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(310): Store=fdeccfa6da1f207cd7d7ef859596ca0c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,792 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,793 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2 2023-02-12 03:03:52,793 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2 2023-02-12 03:03:52,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,793 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdeccfa6da1f207cd7d7ef859596ca0c columnFamilyName f2 2023-02-12 03:03:52,793 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(310): Store=fdeccfa6da1f207cd7d7ef859596ca0c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:52,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 4866d0a2e16b4444f70021950fd29e1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60065539, jitterRate=-0.10495372116565704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 4866d0a2e16b4444f70021950fd29e1c: Running coprocessor pre-open hook at 1676171032782Writing region info on filesystem at 1676171032782Initializing all the Stores at 1676171032783 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032783Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032783Cleaning up temporary data from old regions at 1676171032792 (+9 ms)Cleaning up detritus from prior splits at 1676171032792Running coprocessor post-open hooks at 1676171032796 (+4 ms)Region opened successfully at 1676171032796 2023-02-12 03:03:52,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:52,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c., pid=23, masterSystemTime=1676171032778 2023-02-12 03:03:52,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened fdeccfa6da1f207cd7d7ef859596ca0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66004696, jitterRate=-0.01645338535308838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for fdeccfa6da1f207cd7d7ef859596ca0c: Running coprocessor pre-open hook at 1676171032788Writing region info on filesystem at 1676171032788Initializing all the Stores at 1676171032789 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032789Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032789Cleaning up temporary data from old regions at 1676171032795 (+6 ms)Cleaning up detritus from prior splits at 1676171032795Running coprocessor post-open hooks at 1676171032799 (+4 ms)Region opened successfully at 1676171032799 2023-02-12 03:03:52,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4866d0a2e16b4444f70021950fd29e1c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,800 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032799"}]},"ts":"1676171032799"} 2023-02-12 03:03:52,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c., pid=29, masterSystemTime=1676171032783 2023-02-12 03:03:52,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:52,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b38a5be7071bddacf354fee2d0f2e05d, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 03:03:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,805 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fdeccfa6da1f207cd7d7ef859596ca0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,805 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032804"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032804"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032804"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032804"}]},"ts":"1676171032804"} 2023-02-12 03:03:52,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-12 03:03:52,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 4866d0a2e16b4444f70021950fd29e1c, server=jenkins-hbase6.apache.org,46453,1676171031117 in 177 msec 2023-02-12 03:03:52,806 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1 2023-02-12 03:03:52,806 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1 2023-02-12 03:03:52,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, ASSIGN in 343 msec 2023-02-12 03:03:52,807 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38a5be7071bddacf354fee2d0f2e05d columnFamilyName f1 2023-02-12 03:03:52,807 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(310): Store=b38a5be7071bddacf354fee2d0f2e05d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,807 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-12 03:03:52,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure fdeccfa6da1f207cd7d7ef859596ca0c, server=jenkins-hbase6.apache.org,38635,1676171031086 in 171 msec 2023-02-12 03:03:52,809 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2 2023-02-12 03:03:52,809 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2 2023-02-12 03:03:52,809 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38a5be7071bddacf354fee2d0f2e05d columnFamilyName f2 2023-02-12 03:03:52,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, ASSIGN in 346 msec 2023-02-12 03:03:52,810 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(310): Store=b38a5be7071bddacf354fee2d0f2e05d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:52,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened b38a5be7071bddacf354fee2d0f2e05d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62646520, jitterRate=-0.06649410724639893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for b38a5be7071bddacf354fee2d0f2e05d: Running coprocessor pre-open hook at 1676171032803Writing region info on filesystem at 1676171032803Initializing all the Stores at 1676171032804 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032804Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032804Cleaning up temporary data from old regions at 1676171032811 (+7 ms)Cleaning up detritus from prior splits at 1676171032812 (+1 ms)Running coprocessor post-open hooks at 1676171032816 (+4 ms)Region opened successfully at 1676171032816 2023-02-12 03:03:52,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d., pid=22, masterSystemTime=1676171032778 2023-02-12 03:03:52,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:52,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 10c16957f542d233830d97624ef0c296, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 03:03:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:52,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 176457630362e278d018029d375948d6, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 03:03:52,820 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b38a5be7071bddacf354fee2d0f2e05d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 176457630362e278d018029d375948d6 2023-02-12 03:03:52,820 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032820"}]},"ts":"1676171032820"} 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 176457630362e278d018029d375948d6 2023-02-12 03:03:52,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 176457630362e278d018029d375948d6 2023-02-12 03:03:52,820 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,821 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 176457630362e278d018029d375948d6 2023-02-12 03:03:52,822 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1 2023-02-12 03:03:52,822 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1 2023-02-12 03:03:52,822 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10c16957f542d233830d97624ef0c296 columnFamilyName f1 2023-02-12 03:03:52,823 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(310): Store=10c16957f542d233830d97624ef0c296/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,823 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,823 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1 2023-02-12 03:03:52,823 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1 2023-02-12 03:03:52,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-12 03:03:52,823 INFO [StoreOpener-176457630362e278d018029d375948d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 176457630362e278d018029d375948d6 columnFamilyName f1 2023-02-12 03:03:52,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure b38a5be7071bddacf354fee2d0f2e05d, server=jenkins-hbase6.apache.org,46453,1676171031117 in 197 msec 2023-02-12 03:03:52,824 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(310): Store=176457630362e278d018029d375948d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,824 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 176457630362e278d018029d375948d6 2023-02-12 03:03:52,824 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2 2023-02-12 03:03:52,824 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2 2023-02-12 03:03:52,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, ASSIGN in 361 msec 2023-02-12 03:03:52,825 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10c16957f542d233830d97624ef0c296 columnFamilyName f2 2023-02-12 03:03:52,825 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(310): Store=10c16957f542d233830d97624ef0c296/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,825 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2 2023-02-12 03:03:52,825 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2 2023-02-12 03:03:52,825 INFO [StoreOpener-176457630362e278d018029d375948d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 176457630362e278d018029d375948d6 columnFamilyName f2 2023-02-12 03:03:52,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,826 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(310): Store=176457630362e278d018029d375948d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:52,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:52,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:52,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 176457630362e278d018029d375948d6 2023-02-12 03:03:52,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 10c16957f542d233830d97624ef0c296; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72136897, jitterRate=0.07492353022098541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 10c16957f542d233830d97624ef0c296: Running coprocessor pre-open hook at 1676171032819Writing region info on filesystem at 1676171032819Initializing all the Stores at 1676171032820 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032820Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032820Cleaning up temporary data from old regions at 1676171032827 (+7 ms)Cleaning up detritus from prior splits at 1676171032827Running coprocessor post-open hooks at 1676171032831 (+4 ms)Region opened successfully at 1676171032831 2023-02-12 03:03:52,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 176457630362e278d018029d375948d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59779172, jitterRate=-0.10922092199325562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296., pid=30, masterSystemTime=1676171032783 2023-02-12 03:03:52,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 176457630362e278d018029d375948d6: Running coprocessor pre-open hook at 1676171032820Writing region info on filesystem at 1676171032820Initializing all the Stores at 1676171032821 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032821Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032821Cleaning up temporary data from old regions at 1676171032827 (+6 ms)Cleaning up detritus from prior splits at 1676171032827Running coprocessor post-open hooks at 1676171032832 (+5 ms)Region opened successfully at 1676171032832 2023-02-12 03:03:52,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6., pid=21, masterSystemTime=1676171032778 2023-02-12 03:03:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:52,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5b0045e911fffda0ed4b1f5f6bd3bffe, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 03:03:52,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=10c16957f542d233830d97624ef0c296, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,834 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032833"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032833"}]},"ts":"1676171032833"} 2023-02-12 03:03:52,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=176457630362e278d018029d375948d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032834"}]},"ts":"1676171032834"} 2023-02-12 03:03:52,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:52,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c106a7e7ca705f10c3fedfdb7db9eb8b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 03:03:52,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,836 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,837 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,838 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1 2023-02-12 03:03:52,838 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1 2023-02-12 03:03:52,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-12 03:03:52,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-12 03:03:52,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 176457630362e278d018029d375948d6, server=jenkins-hbase6.apache.org,46453,1676171031117 in 213 msec 2023-02-12 03:03:52,839 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b0045e911fffda0ed4b1f5f6bd3bffe columnFamilyName f1 2023-02-12 03:03:52,839 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f1 2023-02-12 03:03:52,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 10c16957f542d233830d97624ef0c296, server=jenkins-hbase6.apache.org,38635,1676171031086 in 200 msec 2023-02-12 03:03:52,839 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f1 2023-02-12 03:03:52,839 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c106a7e7ca705f10c3fedfdb7db9eb8b columnFamilyName f1 2023-02-12 03:03:52,839 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(310): Store=5b0045e911fffda0ed4b1f5f6bd3bffe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,840 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,840 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(310): Store=c106a7e7ca705f10c3fedfdb7db9eb8b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,840 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, ASSIGN in 377 msec 2023-02-12 03:03:52,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, ASSIGN in 377 msec 2023-02-12 03:03:52,841 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2 2023-02-12 03:03:52,841 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2 2023-02-12 03:03:52,841 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b0045e911fffda0ed4b1f5f6bd3bffe columnFamilyName f2 2023-02-12 03:03:52,842 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(310): Store=5b0045e911fffda0ed4b1f5f6bd3bffe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,842 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f2 2023-02-12 03:03:52,842 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f2 2023-02-12 03:03:52,843 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c106a7e7ca705f10c3fedfdb7db9eb8b columnFamilyName f2 2023-02-12 03:03:52,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,843 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(310): Store=c106a7e7ca705f10c3fedfdb7db9eb8b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:52,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:52,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 5b0045e911fffda0ed4b1f5f6bd3bffe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75400688, jitterRate=0.12355780601501465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Running coprocessor pre-open hook at 1676171032834Writing region info on filesystem at 1676171032834Initializing all the Stores at 1676171032835 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032835Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032835Cleaning up temporary data from old regions at 1676171032844 (+9 ms)Cleaning up detritus from prior splits at 1676171032844Running coprocessor post-open hooks at 1676171032848 (+4 ms)Region opened successfully at 1676171032848 2023-02-12 03:03:52,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe., pid=27, masterSystemTime=1676171032783 2023-02-12 03:03:52,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5b0045e911fffda0ed4b1f5f6bd3bffe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032851"}]},"ts":"1676171032851"} 2023-02-12 03:03:52,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened c106a7e7ca705f10c3fedfdb7db9eb8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63383813, jitterRate=-0.055507585406303406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Running coprocessor pre-open hook at 1676171032836Writing region info on filesystem at 1676171032836Initializing all the Stores at 1676171032837 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032837Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032837Cleaning up temporary data from old regions at 1676171032845 (+8 ms)Cleaning up detritus from prior splits at 1676171032845Running coprocessor post-open hooks at 1676171032851 (+6 ms)Region opened successfully at 1676171032851 2023-02-12 03:03:52,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:52,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b46456aa10812feb1bbc7b780ffcfa2, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 03:03:52,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b., pid=25, masterSystemTime=1676171032778 2023-02-12 03:03:52,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,854 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c106a7e7ca705f10c3fedfdb7db9eb8b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171032855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032855"}]},"ts":"1676171032855"} 2023-02-12 03:03:52,856 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1 2023-02-12 03:03:52,856 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1 2023-02-12 03:03:52,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:52,857 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b46456aa10812feb1bbc7b780ffcfa2 columnFamilyName f1 2023-02-12 03:03:52,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-12 03:03:52,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 5b0045e911fffda0ed4b1f5f6bd3bffe, server=jenkins-hbase6.apache.org,38635,1676171031086 in 222 msec 2023-02-12 03:03:52,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cde8d98d3430cca9a5979706694ddc35, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 03:03:52,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,857 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(310): Store=3b46456aa10812feb1bbc7b780ffcfa2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,857 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, ASSIGN in 395 msec 2023-02-12 03:03:52,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-12 03:03:52,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure c106a7e7ca705f10c3fedfdb7db9eb8b, server=jenkins-hbase6.apache.org,46453,1676171031117 in 229 msec 2023-02-12 03:03:52,859 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2 2023-02-12 03:03:52,859 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2 2023-02-12 03:03:52,859 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b46456aa10812feb1bbc7b780ffcfa2 columnFamilyName f2 2023-02-12 03:03:52,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, ASSIGN in 397 msec 2023-02-12 03:03:52,860 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(310): Store=3b46456aa10812feb1bbc7b780ffcfa2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,862 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,864 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1 2023-02-12 03:03:52,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:52,864 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1 2023-02-12 03:03:52,864 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cde8d98d3430cca9a5979706694ddc35 columnFamilyName f1 2023-02-12 03:03:52,865 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(310): Store=cde8d98d3430cca9a5979706694ddc35/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,865 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,866 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2 2023-02-12 03:03:52,866 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2 2023-02-12 03:03:52,867 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cde8d98d3430cca9a5979706694ddc35 columnFamilyName f2 2023-02-12 03:03:52,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 3b46456aa10812feb1bbc7b780ffcfa2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74659119, jitterRate=0.11250756680965424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 3b46456aa10812feb1bbc7b780ffcfa2: Running coprocessor pre-open hook at 1676171032853Writing region info on filesystem at 1676171032853Initializing all the Stores at 1676171032853Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032854 (+1 ms)Cleaning up temporary data from old regions at 1676171032862 (+8 ms)Cleaning up detritus from prior splits at 1676171032862Running coprocessor post-open hooks at 1676171032867 (+5 ms)Region opened successfully at 1676171032867 2023-02-12 03:03:52,867 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(310): Store=cde8d98d3430cca9a5979706694ddc35/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2., pid=28, masterSystemTime=1676171032783 2023-02-12 03:03:52,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:52,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5256588c4e46c1ac77683a07b572a85d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 03:03:52,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=3b46456aa10812feb1bbc7b780ffcfa2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:52,870 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032870"}]},"ts":"1676171032870"} 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,871 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:52,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-12 03:03:52,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 3b46456aa10812feb1bbc7b780ffcfa2, server=jenkins-hbase6.apache.org,38635,1676171031086 in 239 msec 2023-02-12 03:03:52,874 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1 2023-02-12 03:03:52,874 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1 2023-02-12 03:03:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,875 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5256588c4e46c1ac77683a07b572a85d columnFamilyName f1 2023-02-12 03:03:52,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened cde8d98d3430cca9a5979706694ddc35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58757193, jitterRate=-0.12444959580898285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for cde8d98d3430cca9a5979706694ddc35: Running coprocessor pre-open hook at 1676171032861Writing region info on filesystem at 1676171032861Initializing all the Stores at 1676171032862 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032862Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032862Cleaning up temporary data from old regions at 1676171032869 (+7 ms)Cleaning up detritus from prior splits at 1676171032870 (+1 ms)Running coprocessor post-open hooks at 1676171032875 (+5 ms)Region opened successfully at 1676171032875 2023-02-12 03:03:52,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, ASSIGN in 412 msec 2023-02-12 03:03:52,876 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(310): Store=5256588c4e46c1ac77683a07b572a85d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35., pid=24, masterSystemTime=1676171032778 2023-02-12 03:03:52,876 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:52,877 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2 2023-02-12 03:03:52,877 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2 2023-02-12 03:03:52,877 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cde8d98d3430cca9a5979706694ddc35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:52,878 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032877"}]},"ts":"1676171032877"} 2023-02-12 03:03:52,878 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5256588c4e46c1ac77683a07b572a85d columnFamilyName f2 2023-02-12 03:03:52,879 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(310): Store=5256588c4e46c1ac77683a07b572a85d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:52,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-12 03:03:52,881 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure cde8d98d3430cca9a5979706694ddc35, server=jenkins-hbase6.apache.org,46453,1676171031117 in 252 msec 2023-02-12 03:03:52,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, ASSIGN in 419 msec 2023-02-12 03:03:52,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:52,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:52,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:52,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 5256588c4e46c1ac77683a07b572a85d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70085526, jitterRate=0.04435572028160095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:52,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 5256588c4e46c1ac77683a07b572a85d: Running coprocessor pre-open hook at 1676171032870Writing region info on filesystem at 1676171032870Initializing all the Stores at 1676171032871 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032871Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171032871Cleaning up temporary data from old regions at 1676171032881 (+10 ms)Cleaning up detritus from prior splits at 1676171032881Running coprocessor post-open hooks at 1676171032885 (+4 ms)Region opened successfully at 1676171032885 2023-02-12 03:03:52,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d., pid=26, masterSystemTime=1676171032783 2023-02-12 03:03:52,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:52,888 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5256588c4e46c1ac77683a07b572a85d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:52,888 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171032888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171032888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171032888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171032888"}]},"ts":"1676171032888"} 2023-02-12 03:03:52,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-12 03:03:52,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure 5256588c4e46c1ac77683a07b572a85d, server=jenkins-hbase6.apache.org,38635,1676171031086 in 257 msec 2023-02-12 03:03:52,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-12 03:03:52,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, ASSIGN in 429 msec 2023-02-12 03:03:52,893 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:52,893 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171032893"}]},"ts":"1676171032893"} 2023-02-12 03:03:52,894 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-12 03:03:52,898 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:52,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 542 msec 2023-02-12 03:03:52,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:52,965 INFO [Listener at localhost/36779] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-12 03:03:52,965 DEBUG [Listener at localhost/36779] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-12 03:03:52,965 INFO [Listener at localhost/36779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:52,968 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-12 03:03:52,968 INFO [Listener at localhost/36779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:03:52,968 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-12 03:03:52,968 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:03:53,002 DEBUG [hconnection-0x78e0b87-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:53,009 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:53,015 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:53,021 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38635] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:53,087 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:03:53,087 INFO [Listener at localhost/36779] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:03:53,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 03:03:53,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171033088 (current time:1676171033088). 2023-02-12 03:03:53,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:03:53,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] zookeeper.ReadOnlyZKClient(139): Connect 0x5d310481 to 127.0.0.1:55495 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:53,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583bb3d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:53,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:53,100 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:53,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d310481 to 127.0.0.1:55495 2023-02-12 03:03:53,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:53,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:03:53,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 03:03:53,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 03:03:53,105 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 03:03:53,105 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676171633105 2023-02-12 03:03:53,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 03:03:53,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,107 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:53,108 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 03:03:53,108 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:03:53,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 03:03:53,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-12 03:03:53,110 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 03:03:53,110 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676171633110 2023-02-12 03:03:53,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,119 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 03:03:53,119 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:53,119 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 03:03:53,119 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 03:03:53,120 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,120 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,121 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:53,121 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,121 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:53,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:53,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:53,121 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,121 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,122 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,122 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 03:03:53,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,123 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 03:03:53,123 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 03:03:53,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,123 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 03:03:53,123 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,38635,1676171031086' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 03:03:53,126 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46453,1676171031117' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 03:03:53,128 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,128 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:53,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:53,129 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,129 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:53,129 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,129 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:53,129 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:53,129 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:53,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,38635,1676171031086' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78961b8d[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:53,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:53,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46453,1676171031117' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 03:03:53,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78961b8d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:53,132 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 03:03:53,132 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,134 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,134 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:53,134 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:53,134 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,134 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:53,134 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:53,134 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:53,134 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. started... 2023-02-12 03:03:53,134 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. started... 2023-02-12 03:03:53,139 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 176457630362e278d018029d375948d6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,139 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b38a5be7071bddacf354fee2d0f2e05d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. started... 2023-02-12 03:03:53,139 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:53,139 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:53,139 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 03:03:53,140 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. started... 2023-02-12 03:03:53,140 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:53,140 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5256588c4e46c1ac77683a07b572a85d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:53,139 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. started... 2023-02-12 03:03:53,141 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c106a7e7ca705f10c3fedfdb7db9eb8b: 2023-02-12 03:03:53,141 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,141 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. started... 2023-02-12 03:03:53,142 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5b0045e911fffda0ed4b1f5f6bd3bffe 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,142 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,143 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 10c16957f542d233830d97624ef0c296 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,143 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:53,143 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:53,176 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. completed. 2023-02-12 03:03:53,176 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:53,176 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:53,176 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. started... 2023-02-12 03:03:53,176 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:53,177 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegion(2744): Flushing cde8d98d3430cca9a5979706694ddc35 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,187 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f1/3ddb4fd41359465dad6455fa797367dc 2023-02-12 03:03:53,190 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f1/f9894f7cdb7c4390ab4499605cebdfef 2023-02-12 03:03:53,190 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f1/ac8069fb96db4afdadcd52d6ae56d651 2023-02-12 03:03:53,191 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f1/30336b4c903642d4bde1e8464f42cd0a 2023-02-12 03:03:53,195 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f1/e130f2fad370472faf6cf757d25919bf 2023-02-12 03:03:53,208 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:53,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 03:03:53,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:53,210 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:03:53,210 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f1/435f6e6500cf48b2b2cf82af1dc939ed 2023-02-12 03:03:53,230 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f2/97e4b2496d7d433896e3bc208775e152 2023-02-12 03:03:53,236 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f1/3ddb4fd41359465dad6455fa797367dc as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc 2023-02-12 03:03:53,238 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f2/f8410655d40e44cdb687ac4d1cab1d1f 2023-02-12 03:03:53,241 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,241 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f2/97e4b2496d7d433896e3bc208775e152 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152 2023-02-12 03:03:53,243 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f1/30336b4c903642d4bde1e8464f42cd0a as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a 2023-02-12 03:03:53,246 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,247 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5b0045e911fffda0ed4b1f5f6bd3bffe in 105ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,247 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-12 03:03:53,248 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: 2023-02-12 03:03:53,248 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,254 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,254 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc] hfiles 2023-02-12 03:03:53,254 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,254 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152] hfiles 2023-02-12 03:03:53,255 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,255 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f2/c359a27d10c64f1cb4f92d02f9473dde 2023-02-12 03:03:53,257 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:53,258 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f2/302674bd7c8f4129bf91f5c43f40a611 2023-02-12 03:03:53,260 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f2/980ec6940d87402db7d112a7343f7f0a 2023-02-12 03:03:53,260 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f2/f8410655d40e44cdb687ac4d1cab1d1f as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f 2023-02-12 03:03:53,261 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f1/f9894f7cdb7c4390ab4499605cebdfef as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef 2023-02-12 03:03:53,265 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,266 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f2/c359a27d10c64f1cb4f92d02f9473dde as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde 2023-02-12 03:03:53,270 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. completed. 2023-02-12 03:03:53,270 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:53,270 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:53,270 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. started... 2023-02-12 03:03:53,270 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 03:03:53,271 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3b46456aa10812feb1bbc7b780ffcfa2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 03:03:53,271 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f1/435f6e6500cf48b2b2cf82af1dc939ed as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed 2023-02-12 03:03:53,272 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f1/e130f2fad370472faf6cf757d25919bf as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf 2023-02-12 03:03:53,273 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:53,275 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,276 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 176457630362e278d018029d375948d6 in 137ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 176457630362e278d018029d375948d6: 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef] hfiles 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde] hfiles 2023-02-12 03:03:53,277 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,278 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,278 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5256588c4e46c1ac77683a07b572a85d in 138ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5256588c4e46c1ac77683a07b572a85d: 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,278 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a] hfiles 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,278 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f] hfiles 2023-02-12 03:03:53,279 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,279 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f2/302674bd7c8f4129bf91f5c43f40a611 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611 2023-02-12 03:03:53,279 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f2/980ec6940d87402db7d112a7343f7f0a as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a 2023-02-12 03:03:53,288 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,289 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cde8d98d3430cca9a5979706694ddc35 in 112ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,289 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,289 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cde8d98d3430cca9a5979706694ddc35: 2023-02-12 03:03:53,289 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,290 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,290 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed] hfiles 2023-02-12 03:03:53,290 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,290 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611] hfiles 2023-02-12 03:03:53,290 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,291 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 10c16957f542d233830d97624ef0c296 in 148ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 10c16957f542d233830d97624ef0c296: 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf] hfiles 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a] hfiles 2023-02-12 03:03:53,291 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. completed. 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. completed. 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:53,292 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:53,292 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 03:03:53,292 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:53,293 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. started... 2023-02-12 03:03:53,293 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. started... 2023-02-12 03:03:53,294 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4866d0a2e16b4444f70021950fd29e1c: 2023-02-12 03:03:53,294 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fdeccfa6da1f207cd7d7ef859596ca0c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 03:03:53,294 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,294 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,294 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:53,294 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 03:03:53,302 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. completed. 2023-02-12 03:03:53,303 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:53,303 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:53,306 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. completed. 2023-02-12 03:03:53,306 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:53,306 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 03:03:53,307 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f1/97f67898267f4a7aa59917d9ddcd9362 2023-02-12 03:03:53,320 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f2/783c64a3c523486d8b6745de90526045 2023-02-12 03:03:53,324 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f1/97f67898267f4a7aa59917d9ddcd9362 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362 2023-02-12 03:03:53,328 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,328 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f2/783c64a3c523486d8b6745de90526045 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045 2023-02-12 03:03:53,332 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,332 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fdeccfa6da1f207cd7d7ef859596ca0c in 38ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fdeccfa6da1f207cd7d7ef859596ca0c: 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362] hfiles 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045] hfiles 2023-02-12 03:03:53,333 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,340 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. completed. 2023-02-12 03:03:53,340 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:53,341 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:53,410 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:53,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 03:03:53,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:53,412 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:03:53,647 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f2/d5d60d552d664f68a5426ed6d61872d9 2023-02-12 03:03:53,652 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f1/ac8069fb96db4afdadcd52d6ae56d651 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651 2023-02-12 03:03:53,656 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,657 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f2/d5d60d552d664f68a5426ed6d61872d9 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9 2023-02-12 03:03:53,661 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 03:03:53,662 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b38a5be7071bddacf354fee2d0f2e05d in 523ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b38a5be7071bddacf354fee2d0f2e05d: 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651] hfiles 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9] hfiles 2023-02-12 03:03:53,662 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,668 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. completed. 2023-02-12 03:03:53,668 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:53,668 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 03:03:53,697 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f1/9ae76805493d4c0a92b73f846eec830b 2023-02-12 03:03:53,702 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. completed. 2023-02-12 03:03:53,702 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:53,702 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:53,702 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:53,702 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,702 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 03:03:53,702 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,46453,1676171031117' in zk 2023-02-12 03:03:53,704 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:53,704 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,704 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:53,704 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 03:03:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:53,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,46453,1676171031117': 2023-02-12 03:03:53,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46453,1676171031117' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 03:03:53,710 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f2/03a9d04694c54c718d04ad4eee8d8bbb 2023-02-12 03:03:53,712 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 03:03:53,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:03:53,713 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 03:03:53,714 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f1/9ae76805493d4c0a92b73f846eec830b as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b 2023-02-12 03:03:53,718 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:53,719 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f2/03a9d04694c54c718d04ad4eee8d8bbb as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb 2023-02-12 03:03:53,723 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 03:03:53,726 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 3b46456aa10812feb1bbc7b780ffcfa2 in 455ms, sequenceid=5, compaction requested=false 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3b46456aa10812feb1bbc7b780ffcfa2: 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b] hfiles 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb] hfiles 2023-02-12 03:03:53,727 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,738 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. completed. 2023-02-12 03:03:53,738 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:53,738 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 03:03:53,738 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 03:03:53,738 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,738 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 03:03:53,738 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,38635,1676171031086' in zk 2023-02-12 03:03:53,741 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:53,741 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,741 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:53,741 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 03:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,38635,1676171031086': 2023-02-12 03:03:53,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,38635,1676171031086' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 03:03:53,744 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 03:03:53,744 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:53,744 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:53,744 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,744 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:03:53,746 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:03:53,746 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:53,746 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:53,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:53,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:53,746 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,747 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:53,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,748 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:53,748 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:03:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:53,754 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:03:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:53,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:53,754 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:03:53,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:53,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-12 03:03:53,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:53,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676171033106Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676171033754 (+648 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676171033754Writing data manifest for testWithMockedMapReduceMultiRegion at 1676171033764 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676171033776 (+12 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676171033810 (+34 ms) 2023-02-12 03:03:53,813 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 03:03:53,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 706 msec 2023-02-12 03:03:54,213 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:03:54,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 03:03:54,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:03:54,215 INFO [Listener at localhost/36779] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:03:54,219 INFO [Listener at localhost/36779] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:03:54,225 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:03:54,296 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46453] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,308 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38635] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,368 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:03:54,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:03:54,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,376 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 03:03:54,376 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:54,377 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 03:03:54,377 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 03:03:54,377 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,377 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,379 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:54,379 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:54,379 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:54,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:54,380 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,380 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,380 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,380 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:03:54,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,381 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 03:03:54,381 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:54,382 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:54,382 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 03:03:54,382 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:03:54,383 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,383 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. started... 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. started... 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c106a7e7ca705f10c3fedfdb7db9eb8b: 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. started... 2023-02-12 03:03:54,383 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. started... 2023-02-12 03:03:54,383 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b38a5be7071bddacf354fee2d0f2e05d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,383 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 176457630362e278d018029d375948d6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,383 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5256588c4e46c1ac77683a07b572a85d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,383 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. started... 2023-02-12 03:03:54,383 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:54,384 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cde8d98d3430cca9a5979706694ddc35 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,384 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,384 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. started... 2023-02-12 03:03:54,384 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5b0045e911fffda0ed4b1f5f6bd3bffe 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,384 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 03:03:54,384 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:03:54,384 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,385 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. started... 2023-02-12 03:03:54,385 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 10c16957f542d233830d97624ef0c296 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,406 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f1/7b33f10d757e41fbab1ca2daf8c32009 2023-02-12 03:03:54,419 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f1/390a9618bc2f4ee2845c7ce1b58528da 2023-02-12 03:03:54,439 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f1/5918c77565b5417faea3e20997c0e48e 2023-02-12 03:03:54,453 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f1/7194c15efad54cdeabc079f2ce1c5c2f 2023-02-12 03:03:54,457 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f1/f4768612f9804161b7aedfa659cb7a57 2023-02-12 03:03:54,462 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f1/e3990254269e404da8c11d7146b68a02 2023-02-12 03:03:54,472 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f2/0448aff292d140d181281c3e279d98dd 2023-02-12 03:03:54,473 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f2/d4dc218aec94444e911fdba4ec560797 2023-02-12 03:03:54,482 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f1/390a9618bc2f4ee2845c7ce1b58528da as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/390a9618bc2f4ee2845c7ce1b58528da 2023-02-12 03:03:54,483 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f1/7b33f10d757e41fbab1ca2daf8c32009 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/7b33f10d757e41fbab1ca2daf8c32009 2023-02-12 03:03:54,489 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/390a9618bc2f4ee2845c7ce1b58528da, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,490 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/7b33f10d757e41fbab1ca2daf8c32009, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:54,490 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/.tmp/f2/d4dc218aec94444e911fdba4ec560797 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d4dc218aec94444e911fdba4ec560797 2023-02-12 03:03:54,491 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/.tmp/f2/0448aff292d140d181281c3e279d98dd as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/0448aff292d140d181281c3e279d98dd 2023-02-12 03:03:54,495 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/0448aff292d140d181281c3e279d98dd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:54,495 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d4dc218aec94444e911fdba4ec560797, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,496 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5256588c4e46c1ac77683a07b572a85d in 113ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,496 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b38a5be7071bddacf354fee2d0f2e05d in 113ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,496 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5256588c4e46c1ac77683a07b572a85d: 2023-02-12 03:03:54,496 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b38a5be7071bddacf354fee2d0f2e05d: 2023-02-12 03:03:54,496 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,496 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,496 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:54,496 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,497 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. started... 2023-02-12 03:03:54,497 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4866d0a2e16b4444f70021950fd29e1c: 2023-02-12 03:03:54,497 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,497 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:54,498 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f2/41fdb870baaa43edbf3d7b933963cf73 2023-02-12 03:03:54,499 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:54,499 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. started... 2023-02-12 03:03:54,499 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 03:03:54,499 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3b46456aa10812feb1bbc7b780ffcfa2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 03:03:54,504 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f2/6d68a84f6099462980737e1193a30007 2023-02-12 03:03:54,505 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f1/5918c77565b5417faea3e20997c0e48e as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/5918c77565b5417faea3e20997c0e48e 2023-02-12 03:03:54,512 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f1/f4768612f9804161b7aedfa659cb7a57 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/f4768612f9804161b7aedfa659cb7a57 2023-02-12 03:03:54,514 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/5918c77565b5417faea3e20997c0e48e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,515 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/.tmp/f2/41fdb870baaa43edbf3d7b933963cf73 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/41fdb870baaa43edbf3d7b933963cf73 2023-02-12 03:03:54,524 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f2/194cf8b3be944698a7169d85c45a07b9 2023-02-12 03:03:54,527 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/f4768612f9804161b7aedfa659cb7a57, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,528 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/41fdb870baaa43edbf3d7b933963cf73, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,528 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/.tmp/f2/6d68a84f6099462980737e1193a30007 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/6d68a84f6099462980737e1193a30007 2023-02-12 03:03:54,528 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5b0045e911fffda0ed4b1f5f6bd3bffe in 144ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,529 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: 2023-02-12 03:03:54,529 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,529 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,529 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. started... 2023-02-12 03:03:54,529 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 03:03:54,529 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fdeccfa6da1f207cd7d7ef859596ca0c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 03:03:54,531 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f2/67ab55f7613349ad89304afa00dfb649 2023-02-12 03:03:54,535 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f1/7194c15efad54cdeabc079f2ce1c5c2f as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/7194c15efad54cdeabc079f2ce1c5c2f 2023-02-12 03:03:54,537 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/6d68a84f6099462980737e1193a30007, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,538 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 10c16957f542d233830d97624ef0c296 in 153ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,539 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 10c16957f542d233830d97624ef0c296: 2023-02-12 03:03:54,539 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,539 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 03:03:54,539 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f1/e3990254269e404da8c11d7146b68a02 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/e3990254269e404da8c11d7146b68a02 2023-02-12 03:03:54,540 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f1/fbde05aab5e24cfcb053c79b8cbe8f18 2023-02-12 03:03:54,540 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/7194c15efad54cdeabc079f2ce1c5c2f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,541 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/.tmp/f2/194cf8b3be944698a7169d85c45a07b9 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/194cf8b3be944698a7169d85c45a07b9 2023-02-12 03:03:54,546 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/194cf8b3be944698a7169d85c45a07b9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,546 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 176457630362e278d018029d375948d6 in 163ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,546 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 176457630362e278d018029d375948d6: 2023-02-12 03:03:54,546 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,546 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:54,551 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/e3990254269e404da8c11d7146b68a02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,552 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/.tmp/f2/67ab55f7613349ad89304afa00dfb649 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/67ab55f7613349ad89304afa00dfb649 2023-02-12 03:03:54,556 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f1/7d75663ed8f24c3ea689bf6242d4edf7 2023-02-12 03:03:54,559 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f2/9a093faacc014cd0b5e9f3dec4c378e5 2023-02-12 03:03:54,559 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/67ab55f7613349ad89304afa00dfb649, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,560 INFO [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cde8d98d3430cca9a5979706694ddc35 in 176ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,560 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cde8d98d3430cca9a5979706694ddc35: 2023-02-12 03:03:54,560 DEBUG [rs(jenkins-hbase6.apache.org,46453,1676171031117)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,560 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:54,560 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:54,560 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,560 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 03:03:54,560 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46453,1676171031117' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 03:03:54,562 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,562 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:54,563 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:54,563 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,564 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f1/fbde05aab5e24cfcb053c79b8cbe8f18 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/fbde05aab5e24cfcb053c79b8cbe8f18 2023-02-12 03:03:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:54,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46453,1676171031117' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 03:03:54,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca99047[Count = 1] remaining members to acquire global barrier 2023-02-12 03:03:54,569 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/fbde05aab5e24cfcb053c79b8cbe8f18, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:54,569 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f2/d2224a9d10424215b4e02142d3847e74 2023-02-12 03:03:54,570 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/.tmp/f2/9a093faacc014cd0b5e9f3dec4c378e5 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/9a093faacc014cd0b5e9f3dec4c378e5 2023-02-12 03:03:54,574 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/9a093faacc014cd0b5e9f3dec4c378e5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 03:03:54,575 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 3b46456aa10812feb1bbc7b780ffcfa2 in 76ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,575 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b46456aa10812feb1bbc7b780ffcfa2: 2023-02-12 03:03:54,575 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f1/7d75663ed8f24c3ea689bf6242d4edf7 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/7d75663ed8f24c3ea689bf6242d4edf7 2023-02-12 03:03:54,575 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:54,575 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 03:03:54,578 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/7d75663ed8f24c3ea689bf6242d4edf7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,579 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/.tmp/f2/d2224a9d10424215b4e02142d3847e74 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/d2224a9d10424215b4e02142d3847e74 2023-02-12 03:03:54,583 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/d2224a9d10424215b4e02142d3847e74, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 03:03:54,583 INFO [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fdeccfa6da1f207cd7d7ef859596ca0c in 54ms, sequenceid=9, compaction requested=false 2023-02-12 03:03:54,583 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fdeccfa6da1f207cd7d7ef859596ca0c: 2023-02-12 03:03:54,584 DEBUG [rs(jenkins-hbase6.apache.org,38635,1676171031086)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,584 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 03:03:54,584 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 03:03:54,584 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,584 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 03:03:54,584 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,38635,1676171031086' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 03:03:54,585 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,586 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:54,586 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,586 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,38635,1676171031086' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 03:03:54,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca99047[Count = 0] remaining members to acquire global barrier 2023-02-12 03:03:54,588 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 03:03:54,588 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,38635,1676171031086' in zk 2023-02-12 03:03:54,589 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,589 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase6.apache.org,46453,1676171031117' in zk 2023-02-12 03:03:54,590 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,590 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:03:54,592 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,592 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:54,592 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:54,592 DEBUG [member: 'jenkins-hbase6.apache.org,38635,1676171031086' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 03:03:54,593 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,593 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 03:03:54,593 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:54,593 DEBUG [member: 'jenkins-hbase6.apache.org,46453,1676171031117' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 03:03:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,38635,1676171031086': 2023-02-12 03:03:54,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,38635,1676171031086' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase6.apache.org,46453,1676171031117': 2023-02-12 03:03:54,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46453,1676171031117' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 03:03:54,598 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 03:03:54,598 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:03:54,598 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:03:54,598 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,598 INFO [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:03:54,600 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:03:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:54,600 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:03:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,600 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:54,601 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,601 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:03:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,602 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,603 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:03:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:54,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:03:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:03:54,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-12 03:03:54,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:03:54,606 DEBUG [(jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:03:54,605 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-12 03:03:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:03:54,606 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:03:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:54,706 DEBUG [Listener at localhost/36779] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:03:54,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:03:54,713 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676171033088 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:54,713 DEBUG [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 176457630362e278d018029d375948d6 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(239): region to add: fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=b38a5be7071bddacf354fee2d0f2e05d as b38a5be7071bddacf354fee2d0f2e05d in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=5256588c4e46c1ac77683a07b572a85d as 5256588c4e46c1ac77683a07b572a85d in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=176457630362e278d018029d375948d6 as 176457630362e278d018029d375948d6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=5b0045e911fffda0ed4b1f5f6bd3bffe as 5b0045e911fffda0ed4b1f5f6bd3bffe in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=c106a7e7ca705f10c3fedfdb7db9eb8b as c106a7e7ca705f10c3fedfdb7db9eb8b in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=10c16957f542d233830d97624ef0c296 as 10c16957f542d233830d97624ef0c296 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,714 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=cde8d98d3430cca9a5979706694ddc35 as cde8d98d3430cca9a5979706694ddc35 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,715 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=3b46456aa10812feb1bbc7b780ffcfa2 as 3b46456aa10812feb1bbc7b780ffcfa2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,715 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=4866d0a2e16b4444f70021950fd29e1c as 4866d0a2e16b4444f70021950fd29e1c in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,715 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(585): clone region=fdeccfa6da1f207cd7d7ef859596ca0c as fdeccfa6da1f207cd7d7ef859596ca0c in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,716 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => cde8d98d3430cca9a5979706694ddc35, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,716 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b38a5be7071bddacf354fee2d0f2e05d, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,716 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 10c16957f542d233830d97624ef0c296, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,717 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 176457630362e278d018029d375948d6, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,717 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5256588c4e46c1ac77683a07b572a85d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,717 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 5b0045e911fffda0ed4b1f5f6bd3bffe, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,718 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 3b46456aa10812feb1bbc7b780ffcfa2, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,718 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c106a7e7ca705f10c3fedfdb7db9eb8b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,751 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,751 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e130f2fad370472faf6cf757d25919bf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,759 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,759 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ddb4fd41359465dad6455fa797367dc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,759 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 980ec6940d87402db7d112a7343f7f0a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c106a7e7ca705f10c3fedfdb7db9eb8b, disabling compactions & flushes 2023-02-12 03:03:54,768 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. after waiting 0 ms 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,768 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:54,768 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Waiting for close lock at 1676171034768Disabling compacts and flushes for region at 1676171034768Disabling writes for close at 1676171034768Writing region close event to WAL at 1676171034768Closed at 1676171034768 2023-02-12 03:03:54,769 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 4866d0a2e16b4444f70021950fd29e1c, NAME => 'testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,769 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 10c16957f542d233830d97624ef0c296, disabling compactions & flushes 2023-02-12 03:03:54,769 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,769 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,769 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,769 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. after waiting 0 ms 2023-02-12 03:03:54,769 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 30336b4c903642d4bde1e8464f42cd0a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,770 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97e4b2496d7d433896e3bc208775e152 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,769 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,770 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:54,770 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 10c16957f542d233830d97624ef0c296: Waiting for close lock at 1676171034769Disabling compacts and flushes for region at 1676171034769Disabling writes for close at 1676171034769Writing region close event to WAL at 1676171034770 (+1 ms)Closed at 1676171034770 2023-02-12 03:03:54,770 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => fdeccfa6da1f207cd7d7ef859596ca0c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:54,773 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,773 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,773 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9894f7cdb7c4390ab4499605cebdfef from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,773 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 435f6e6500cf48b2b2cf82af1dc939ed from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,775 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,775 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac8069fb96db4afdadcd52d6ae56d651 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,784 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f8410655d40e44cdb687ac4d1cab1d1f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,785 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 5b0045e911fffda0ed4b1f5f6bd3bffe, disabling compactions & flushes 2023-02-12 03:03:54,785 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,785 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,785 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. after waiting 0 ms 2023-02-12 03:03:54,785 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,786 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:54,786 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Waiting for close lock at 1676171034785Disabling compacts and flushes for region at 1676171034785Disabling writes for close at 1676171034785Writing region close event to WAL at 1676171034786 (+1 ms)Closed at 1676171034786 2023-02-12 03:03:54,790 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 302674bd7c8f4129bf91f5c43f40a611 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,790 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c359a27d10c64f1cb4f92d02f9473dde from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,791 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5d60d552d664f68a5426ed6d61872d9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,791 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 5256588c4e46c1ac77683a07b572a85d, disabling compactions & flushes 2023-02-12 03:03:54,791 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,791 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,791 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. after waiting 0 ms 2023-02-12 03:03:54,791 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,791 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:54,792 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 5256588c4e46c1ac77683a07b572a85d: Waiting for close lock at 1676171034791Disabling compacts and flushes for region at 1676171034791Disabling writes for close at 1676171034791Writing region close event to WAL at 1676171034791Closed at 1676171034791 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b38a5be7071bddacf354fee2d0f2e05d, disabling compactions & flushes 2023-02-12 03:03:54,795 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing cde8d98d3430cca9a5979706694ddc35, disabling compactions & flushes 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. after waiting 0 ms 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,795 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,795 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. after waiting 0 ms 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b38a5be7071bddacf354fee2d0f2e05d: Waiting for close lock at 1676171034795Disabling compacts and flushes for region at 1676171034795Disabling writes for close at 1676171034795Writing region close event to WAL at 1676171034795Closed at 1676171034795 2023-02-12 03:03:54,795 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:54,795 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for cde8d98d3430cca9a5979706694ddc35: Waiting for close lock at 1676171034795Disabling compacts and flushes for region at 1676171034795Disabling writes for close at 1676171034795Writing region close event to WAL at 1676171034795Closed at 1676171034795 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 176457630362e278d018029d375948d6, disabling compactions & flushes 2023-02-12 03:03:54,799 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. after waiting 0 ms 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,799 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 176457630362e278d018029d375948d6: Waiting for close lock at 1676171034799Disabling compacts and flushes for region at 1676171034799Disabling writes for close at 1676171034799Writing region close event to WAL at 1676171034799Closed at 1676171034799 2023-02-12 03:03:54,799 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,799 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 97f67898267f4a7aa59917d9ddcd9362 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,800 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:54,801 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 4866d0a2e16b4444f70021950fd29e1c, disabling compactions & flushes 2023-02-12 03:03:54,801 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,801 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,801 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. after waiting 0 ms 2023-02-12 03:03:54,801 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,801 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:54,801 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 4866d0a2e16b4444f70021950fd29e1c: Waiting for close lock at 1676171034800Disabling compacts and flushes for region at 1676171034801 (+1 ms)Disabling writes for close at 1676171034801Writing region close event to WAL at 1676171034801Closed at 1676171034801 2023-02-12 03:03:54,801 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 783c64a3c523486d8b6745de90526045 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:54,803 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing fdeccfa6da1f207cd7d7ef859596ca0c, disabling compactions & flushes 2023-02-12 03:03:54,803 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,803 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,803 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. after waiting 0 ms 2023-02-12 03:03:54,803 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,803 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:54,803 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for fdeccfa6da1f207cd7d7ef859596ca0c: Waiting for close lock at 1676171034803Disabling compacts and flushes for region at 1676171034803Disabling writes for close at 1676171034803Writing region close event to WAL at 1676171034803Closed at 1676171034803 2023-02-12 03:03:55,184 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,184 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ae76805493d4c0a92b73f846eec830b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:55,187 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 03a9d04694c54c718d04ad4eee8d8bbb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:55,188 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 3b46456aa10812feb1bbc7b780ffcfa2, disabling compactions & flushes 2023-02-12 03:03:55,188 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,189 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,189 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. after waiting 0 ms 2023-02-12 03:03:55,189 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,189 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,189 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 3b46456aa10812feb1bbc7b780ffcfa2: Waiting for close lock at 1676171035188Disabling compacts and flushes for region at 1676171035188Disabling writes for close at 1676171035189 (+1 ms)Writing region close event to WAL at 1676171035189Closed at 1676171035189 2023-02-12 03:03:55,189 INFO [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676171033088 type: FLUSH version: 2 ttl: 0 2023-02-12 03:03:55,189 DEBUG [Listener at localhost/36779] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:55,189 DEBUG [Listener at localhost/36779] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b 2023-02-12 03:03:55,190 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-data/ 2023-02-12 03:03:55,190 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----default/ 2023-02-12 03:03:55,191 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-12 03:03:55,191 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------10c16957f542d233830d97624ef0c296/ 2023-02-12 03:03:55,191 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,191 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=10c16957f542d233830d97624ef0c296-e130f2fad370472faf6cf757d25919bf 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=10c16957f542d233830d97624ef0c296-980ec6940d87402db7d112a7343f7f0a 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------176457630362e278d018029d375948d6/ 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,192 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=176457630362e278d018029d375948d6-f9894f7cdb7c4390ab4499605cebdfef 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=176457630362e278d018029d375948d6-c359a27d10c64f1cb4f92d02f9473dde 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------3b46456aa10812feb1bbc7b780ffcfa2/ 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,193 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,194 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3b46456aa10812feb1bbc7b780ffcfa2-9ae76805493d4c0a92b73f846eec830b 2023-02-12 03:03:55,194 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,194 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3b46456aa10812feb1bbc7b780ffcfa2-03a9d04694c54c718d04ad4eee8d8bbb 2023-02-12 03:03:55,194 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------4866d0a2e16b4444f70021950fd29e1c/ 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------5256588c4e46c1ac77683a07b572a85d/ 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5256588c4e46c1ac77683a07b572a85d-30336b4c903642d4bde1e8464f42cd0a 2023-02-12 03:03:55,195 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5256588c4e46c1ac77683a07b572a85d-f8410655d40e44cdb687ac4d1cab1d1f 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------5b0045e911fffda0ed4b1f5f6bd3bffe/ 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5b0045e911fffda0ed4b1f5f6bd3bffe-3ddb4fd41359465dad6455fa797367dc 2023-02-12 03:03:55,196 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5b0045e911fffda0ed4b1f5f6bd3bffe-97e4b2496d7d433896e3bc208775e152 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------b38a5be7071bddacf354fee2d0f2e05d/ 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b38a5be7071bddacf354fee2d0f2e05d-ac8069fb96db4afdadcd52d6ae56d651 2023-02-12 03:03:55,197 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b38a5be7071bddacf354fee2d0f2e05d-d5d60d552d664f68a5426ed6d61872d9 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------c106a7e7ca705f10c3fedfdb7db9eb8b/ 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------cde8d98d3430cca9a5979706694ddc35/ 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,198 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,199 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cde8d98d3430cca9a5979706694ddc35-435f6e6500cf48b2b2cf82af1dc939ed 2023-02-12 03:03:55,199 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,199 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cde8d98d3430cca9a5979706694ddc35-302674bd7c8f4129bf91f5c43f40a611 2023-02-12 03:03:55,199 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |----------fdeccfa6da1f207cd7d7ef859596ca0c/ 2023-02-12 03:03:55,199 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:03:55,200 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:03:55,200 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fdeccfa6da1f207cd7d7ef859596ca0c-97f67898267f4a7aa59917d9ddcd9362 2023-02-12 03:03:55,200 DEBUG [Listener at localhost/36779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:03:55,200 DEBUG [Listener at localhost/36779] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=fdeccfa6da1f207cd7d7ef859596ca0c-783c64a3c523486d8b6745de90526045 2023-02-12 03:03:55,203 INFO [Listener at localhost/36779] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 03:03:55,747 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,747 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,749 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,752 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:55,753 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1 2023-02-12 03:03:55,753 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10c16957f542d233830d97624ef0c296 columnFamilyName f1 2023-02-12 03:03:55,757 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/testWithMockedMapReduceMultiRegion=10c16957f542d233830d97624ef0c296-e130f2fad370472faf6cf757d25919bf 2023-02-12 03:03:55,757 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(310): Store=10c16957f542d233830d97624ef0c296/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,757 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:55,758 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2 2023-02-12 03:03:55,758 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10c16957f542d233830d97624ef0c296 columnFamilyName f2 2023-02-12 03:03:55,762 DEBUG [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/testWithMockedMapReduceMultiRegion=10c16957f542d233830d97624ef0c296-980ec6940d87402db7d112a7343f7f0a 2023-02-12 03:03:55,762 INFO [StoreOpener-10c16957f542d233830d97624ef0c296-1] regionserver.HStore(310): Store=10c16957f542d233830d97624ef0c296/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,762 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,762 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 10c16957f542d233830d97624ef0c296; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61519935, jitterRate=-0.08328153192996979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,762 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 10c16957f542d233830d97624ef0c296: Writing region info on filesystem at 1676171035749Initializing all the Stores at 1676171035750 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035750Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035751 (+1 ms)Region opened successfully at 1676171035762 (+11 ms) 2023-02-12 03:03:55,771 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 10c16957f542d233830d97624ef0c296, disabling compactions & flushes 2023-02-12 03:03:55,772 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:55,772 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:55,772 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. after waiting 0 ms 2023-02-12 03:03:55,772 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:55,773 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:55,773 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 10c16957f542d233830d97624ef0c296: Waiting for close lock at 1676171035771Disabling compacts and flushes for region at 1676171035771Disabling writes for close at 1676171035772 (+1 ms)Writing region close event to WAL at 1676171035773 (+1 ms)Closed at 1676171035773 2023-02-12 03:03:55,774 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,774 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,776 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,777 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 176457630362e278d018029d375948d6 2023-02-12 03:03:55,778 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1 2023-02-12 03:03:55,779 INFO [StoreOpener-176457630362e278d018029d375948d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 176457630362e278d018029d375948d6 columnFamilyName f1 2023-02-12 03:03:55,783 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/testWithMockedMapReduceMultiRegion=176457630362e278d018029d375948d6-f9894f7cdb7c4390ab4499605cebdfef 2023-02-12 03:03:55,783 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(310): Store=176457630362e278d018029d375948d6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,783 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 176457630362e278d018029d375948d6 2023-02-12 03:03:55,784 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2 2023-02-12 03:03:55,784 INFO [StoreOpener-176457630362e278d018029d375948d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 176457630362e278d018029d375948d6 columnFamilyName f2 2023-02-12 03:03:55,789 DEBUG [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/testWithMockedMapReduceMultiRegion=176457630362e278d018029d375948d6-c359a27d10c64f1cb4f92d02f9473dde 2023-02-12 03:03:55,789 INFO [StoreOpener-176457630362e278d018029d375948d6-1] regionserver.HStore(310): Store=176457630362e278d018029d375948d6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,790 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,790 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 176457630362e278d018029d375948d6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73124141, jitterRate=0.08963461220264435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,790 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 176457630362e278d018029d375948d6: Writing region info on filesystem at 1676171035776Initializing all the Stores at 1676171035776Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035776Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035777 (+1 ms)Region opened successfully at 1676171035790 (+13 ms) 2023-02-12 03:03:55,798 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 176457630362e278d018029d375948d6, disabling compactions & flushes 2023-02-12 03:03:55,798 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:55,799 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:55,799 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. after waiting 0 ms 2023-02-12 03:03:55,799 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:55,799 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:55,799 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 176457630362e278d018029d375948d6: Waiting for close lock at 1676171035798Disabling compacts and flushes for region at 1676171035798Disabling writes for close at 1676171035799 (+1 ms)Writing region close event to WAL at 1676171035799Closed at 1676171035799 2023-02-12 03:03:55,800 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,800 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,802 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,804 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:55,805 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f1 2023-02-12 03:03:55,806 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4866d0a2e16b4444f70021950fd29e1c columnFamilyName f1 2023-02-12 03:03:55,806 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(310): Store=4866d0a2e16b4444f70021950fd29e1c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,806 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:55,808 DEBUG [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f2 2023-02-12 03:03:55,808 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4866d0a2e16b4444f70021950fd29e1c columnFamilyName f2 2023-02-12 03:03:55,808 INFO [StoreOpener-4866d0a2e16b4444f70021950fd29e1c-1] regionserver.HStore(310): Store=4866d0a2e16b4444f70021950fd29e1c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,809 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 4866d0a2e16b4444f70021950fd29e1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70279550, jitterRate=0.04724690318107605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 4866d0a2e16b4444f70021950fd29e1c: Writing region info on filesystem at 1676171035802Initializing all the Stores at 1676171035803 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035803Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035803Region opened successfully at 1676171035809 (+6 ms) 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 4866d0a2e16b4444f70021950fd29e1c, disabling compactions & flushes 2023-02-12 03:03:55,809 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. after waiting 0 ms 2023-02-12 03:03:55,809 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:55,809 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:55,810 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 4866d0a2e16b4444f70021950fd29e1c: Waiting for close lock at 1676171035809Disabling compacts and flushes for region at 1676171035809Disabling writes for close at 1676171035809Writing region close event to WAL at 1676171035809Closed at 1676171035809 2023-02-12 03:03:55,810 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,810 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,812 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,814 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:55,814 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1 2023-02-12 03:03:55,815 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b0045e911fffda0ed4b1f5f6bd3bffe columnFamilyName f1 2023-02-12 03:03:55,822 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/testWithMockedMapReduceMultiRegion=5b0045e911fffda0ed4b1f5f6bd3bffe-3ddb4fd41359465dad6455fa797367dc 2023-02-12 03:03:55,822 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(310): Store=5b0045e911fffda0ed4b1f5f6bd3bffe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,823 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:55,823 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2 2023-02-12 03:03:55,824 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b0045e911fffda0ed4b1f5f6bd3bffe columnFamilyName f2 2023-02-12 03:03:55,828 DEBUG [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/testWithMockedMapReduceMultiRegion=5b0045e911fffda0ed4b1f5f6bd3bffe-97e4b2496d7d433896e3bc208775e152 2023-02-12 03:03:55,828 INFO [StoreOpener-5b0045e911fffda0ed4b1f5f6bd3bffe-1] regionserver.HStore(310): Store=5b0045e911fffda0ed4b1f5f6bd3bffe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,828 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,828 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 5b0045e911fffda0ed4b1f5f6bd3bffe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73818704, jitterRate=0.09998440742492676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,828 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Writing region info on filesystem at 1676171035812Initializing all the Stores at 1676171035812Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035813 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035813Region opened successfully at 1676171035828 (+15 ms) 2023-02-12 03:03:55,837 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 5b0045e911fffda0ed4b1f5f6bd3bffe, disabling compactions & flushes 2023-02-12 03:03:55,838 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:55,838 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:55,838 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. after waiting 0 ms 2023-02-12 03:03:55,839 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:55,839 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:55,839 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Waiting for close lock at 1676171035837Disabling compacts and flushes for region at 1676171035837Disabling writes for close at 1676171035839 (+2 ms)Writing region close event to WAL at 1676171035839Closed at 1676171035839 2023-02-12 03:03:55,840 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,840 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,841 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,843 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:55,844 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1 2023-02-12 03:03:55,844 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b46456aa10812feb1bbc7b780ffcfa2 columnFamilyName f1 2023-02-12 03:03:55,849 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/testWithMockedMapReduceMultiRegion=3b46456aa10812feb1bbc7b780ffcfa2-9ae76805493d4c0a92b73f846eec830b 2023-02-12 03:03:55,849 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(310): Store=3b46456aa10812feb1bbc7b780ffcfa2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,849 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:55,850 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2 2023-02-12 03:03:55,850 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b46456aa10812feb1bbc7b780ffcfa2 columnFamilyName f2 2023-02-12 03:03:55,855 DEBUG [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/testWithMockedMapReduceMultiRegion=3b46456aa10812feb1bbc7b780ffcfa2-03a9d04694c54c718d04ad4eee8d8bbb 2023-02-12 03:03:55,855 INFO [StoreOpener-3b46456aa10812feb1bbc7b780ffcfa2-1] regionserver.HStore(310): Store=3b46456aa10812feb1bbc7b780ffcfa2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,855 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,855 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 3b46456aa10812feb1bbc7b780ffcfa2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59600701, jitterRate=-0.1118803471326828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,855 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 3b46456aa10812feb1bbc7b780ffcfa2: Writing region info on filesystem at 1676171035841Initializing all the Stores at 1676171035842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035842Region opened successfully at 1676171035855 (+13 ms) 2023-02-12 03:03:55,871 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 3b46456aa10812feb1bbc7b780ffcfa2, disabling compactions & flushes 2023-02-12 03:03:55,871 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,871 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,871 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. after waiting 0 ms 2023-02-12 03:03:55,872 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,874 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:55,874 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 3b46456aa10812feb1bbc7b780ffcfa2: Waiting for close lock at 1676171035871Disabling compacts and flushes for region at 1676171035871Disabling writes for close at 1676171035872 (+1 ms)Writing region close event to WAL at 1676171035874 (+2 ms)Closed at 1676171035874 2023-02-12 03:03:55,875 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,875 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,877 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,880 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:55,881 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1 2023-02-12 03:03:55,881 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cde8d98d3430cca9a5979706694ddc35 columnFamilyName f1 2023-02-12 03:03:55,886 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/testWithMockedMapReduceMultiRegion=cde8d98d3430cca9a5979706694ddc35-435f6e6500cf48b2b2cf82af1dc939ed 2023-02-12 03:03:55,886 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(310): Store=cde8d98d3430cca9a5979706694ddc35/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,886 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:55,887 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2 2023-02-12 03:03:55,887 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cde8d98d3430cca9a5979706694ddc35 columnFamilyName f2 2023-02-12 03:03:55,891 DEBUG [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/testWithMockedMapReduceMultiRegion=cde8d98d3430cca9a5979706694ddc35-302674bd7c8f4129bf91f5c43f40a611 2023-02-12 03:03:55,892 INFO [StoreOpener-cde8d98d3430cca9a5979706694ddc35-1] regionserver.HStore(310): Store=cde8d98d3430cca9a5979706694ddc35/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,892 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,892 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened cde8d98d3430cca9a5979706694ddc35; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65313748, jitterRate=-0.02674931287765503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,892 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for cde8d98d3430cca9a5979706694ddc35: Writing region info on filesystem at 1676171035877Initializing all the Stores at 1676171035877Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035878 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035879 (+1 ms)Region opened successfully at 1676171035892 (+13 ms) 2023-02-12 03:03:55,900 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing cde8d98d3430cca9a5979706694ddc35, disabling compactions & flushes 2023-02-12 03:03:55,900 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:55,900 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:55,900 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. after waiting 0 ms 2023-02-12 03:03:55,900 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:55,901 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:55,901 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for cde8d98d3430cca9a5979706694ddc35: Waiting for close lock at 1676171035900Disabling compacts and flushes for region at 1676171035900Disabling writes for close at 1676171035900Writing region close event to WAL at 1676171035901 (+1 ms)Closed at 1676171035901 2023-02-12 03:03:55,902 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,902 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,904 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,908 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:55,908 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1 2023-02-12 03:03:55,909 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38a5be7071bddacf354fee2d0f2e05d columnFamilyName f1 2023-02-12 03:03:55,913 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/testWithMockedMapReduceMultiRegion=b38a5be7071bddacf354fee2d0f2e05d-ac8069fb96db4afdadcd52d6ae56d651 2023-02-12 03:03:55,913 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(310): Store=b38a5be7071bddacf354fee2d0f2e05d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,914 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:55,914 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2 2023-02-12 03:03:55,915 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b38a5be7071bddacf354fee2d0f2e05d columnFamilyName f2 2023-02-12 03:03:55,918 DEBUG [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/testWithMockedMapReduceMultiRegion=b38a5be7071bddacf354fee2d0f2e05d-d5d60d552d664f68a5426ed6d61872d9 2023-02-12 03:03:55,918 INFO [StoreOpener-b38a5be7071bddacf354fee2d0f2e05d-1] regionserver.HStore(310): Store=b38a5be7071bddacf354fee2d0f2e05d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,919 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,919 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened b38a5be7071bddacf354fee2d0f2e05d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74106019, jitterRate=0.1042657345533371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,919 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for b38a5be7071bddacf354fee2d0f2e05d: Writing region info on filesystem at 1676171035904Initializing all the Stores at 1676171035905 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035905Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035906 (+1 ms)Region opened successfully at 1676171035919 (+13 ms) 2023-02-12 03:03:55,930 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing b38a5be7071bddacf354fee2d0f2e05d, disabling compactions & flushes 2023-02-12 03:03:55,930 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:55,930 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:55,930 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. after waiting 0 ms 2023-02-12 03:03:55,930 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:55,933 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:55,933 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for b38a5be7071bddacf354fee2d0f2e05d: Waiting for close lock at 1676171035930Disabling compacts and flushes for region at 1676171035930Disabling writes for close at 1676171035930Writing region close event to WAL at 1676171035933 (+3 ms)Closed at 1676171035933 2023-02-12 03:03:55,934 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,934 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,935 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,937 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:55,938 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1 2023-02-12 03:03:55,938 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdeccfa6da1f207cd7d7ef859596ca0c columnFamilyName f1 2023-02-12 03:03:55,943 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/testWithMockedMapReduceMultiRegion=fdeccfa6da1f207cd7d7ef859596ca0c-97f67898267f4a7aa59917d9ddcd9362 2023-02-12 03:03:55,943 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(310): Store=fdeccfa6da1f207cd7d7ef859596ca0c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,943 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:55,944 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2 2023-02-12 03:03:55,944 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdeccfa6da1f207cd7d7ef859596ca0c columnFamilyName f2 2023-02-12 03:03:55,947 DEBUG [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/testWithMockedMapReduceMultiRegion=fdeccfa6da1f207cd7d7ef859596ca0c-783c64a3c523486d8b6745de90526045 2023-02-12 03:03:55,948 INFO [StoreOpener-fdeccfa6da1f207cd7d7ef859596ca0c-1] regionserver.HStore(310): Store=fdeccfa6da1f207cd7d7ef859596ca0c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,948 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,948 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened fdeccfa6da1f207cd7d7ef859596ca0c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73877601, jitterRate=0.1008620411157608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,948 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for fdeccfa6da1f207cd7d7ef859596ca0c: Writing region info on filesystem at 1676171035935Initializing all the Stores at 1676171035936 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035936Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035936Region opened successfully at 1676171035948 (+12 ms) 2023-02-12 03:03:55,956 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing fdeccfa6da1f207cd7d7ef859596ca0c, disabling compactions & flushes 2023-02-12 03:03:55,956 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:55,956 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:55,956 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. after waiting 0 ms 2023-02-12 03:03:55,956 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:55,957 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:55,957 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for fdeccfa6da1f207cd7d7ef859596ca0c: Waiting for close lock at 1676171035956Disabling compacts and flushes for region at 1676171035956Disabling writes for close at 1676171035956Writing region close event to WAL at 1676171035957 (+1 ms)Closed at 1676171035957 2023-02-12 03:03:55,958 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,958 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,959 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,961 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:55,962 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1 2023-02-12 03:03:55,962 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5256588c4e46c1ac77683a07b572a85d columnFamilyName f1 2023-02-12 03:03:55,966 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/testWithMockedMapReduceMultiRegion=5256588c4e46c1ac77683a07b572a85d-30336b4c903642d4bde1e8464f42cd0a 2023-02-12 03:03:55,966 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(310): Store=5256588c4e46c1ac77683a07b572a85d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,966 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:55,967 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2 2023-02-12 03:03:55,967 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5256588c4e46c1ac77683a07b572a85d columnFamilyName f2 2023-02-12 03:03:55,971 DEBUG [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(539): loaded hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/testWithMockedMapReduceMultiRegion=5256588c4e46c1ac77683a07b572a85d-f8410655d40e44cdb687ac4d1cab1d1f 2023-02-12 03:03:55,971 INFO [StoreOpener-5256588c4e46c1ac77683a07b572a85d-1] regionserver.HStore(310): Store=5256588c4e46c1ac77683a07b572a85d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,971 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,971 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened 5256588c4e46c1ac77683a07b572a85d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60519971, jitterRate=-0.09818215668201447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,971 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for 5256588c4e46c1ac77683a07b572a85d: Writing region info on filesystem at 1676171035959Initializing all the Stores at 1676171035960 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035960Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035960Region opened successfully at 1676171035971 (+11 ms) 2023-02-12 03:03:55,981 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing 5256588c4e46c1ac77683a07b572a85d, disabling compactions & flushes 2023-02-12 03:03:55,981 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:55,981 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:55,981 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. after waiting 0 ms 2023-02-12 03:03:55,981 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:55,982 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:55,982 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for 5256588c4e46c1ac77683a07b572a85d: Waiting for close lock at 1676171035981Disabling compacts and flushes for region at 1676171035981Disabling writes for close at 1676171035981Writing region close event to WAL at 1676171035982 (+1 ms)Closed at 1676171035982 2023-02-12 03:03:55,983 DEBUG [Listener at localhost/36779] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:55,983 INFO [Listener at localhost/36779] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:03:55,984 DEBUG [Listener at localhost/36779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:55,986 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:55,987 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f1 2023-02-12 03:03:55,987 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c106a7e7ca705f10c3fedfdb7db9eb8b columnFamilyName f1 2023-02-12 03:03:55,988 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(310): Store=c106a7e7ca705f10c3fedfdb7db9eb8b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,988 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:55,989 DEBUG [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41745/user/jenkins/test-data/d940006c-fd51-3d0b-517c-a2f532dd8994/testWithMockedMapReduceMultiRegion/2964cee6-efc8-4764-8dd3-16e9e3a10c7b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f2 2023-02-12 03:03:55,989 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c106a7e7ca705f10c3fedfdb7db9eb8b columnFamilyName f2 2023-02-12 03:03:55,989 INFO [StoreOpener-c106a7e7ca705f10c3fedfdb7db9eb8b-1] regionserver.HStore(310): Store=c106a7e7ca705f10c3fedfdb7db9eb8b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:55,989 DEBUG [Listener at localhost/36779] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:55,990 INFO [Listener at localhost/36779] regionserver.HRegion(1071): Opened c106a7e7ca705f10c3fedfdb7db9eb8b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72301847, jitterRate=0.07738147675991058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(964): Region open journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Writing region info on filesystem at 1676171035984Initializing all the Stores at 1676171035985 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035985Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171035985Region opened successfully at 1676171035990 (+5 ms) 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(1603): Closing c106a7e7ca705f10c3fedfdb7db9eb8b, disabling compactions & flushes 2023-02-12 03:03:55,990 INFO [Listener at localhost/36779] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. after waiting 0 ms 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:55,990 INFO [Listener at localhost/36779] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:55,990 DEBUG [Listener at localhost/36779] regionserver.HRegion(1557): Region close journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Waiting for close lock at 1676171035990Disabling compacts and flushes for region at 1676171035990Disabling writes for close at 1676171035990Writing region close event to WAL at 1676171035990Closed at 1676171035990 2023-02-12 03:03:55,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-12 03:03:55,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-12 03:03:55,999 INFO [Listener at localhost/36779] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 03:03:55,999 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:56,002 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171036002"}]},"ts":"1676171036002"} 2023-02-12 03:03:56,003 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-12 03:03:56,087 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-12 03:03:56,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, UNASSIGN}] 2023-02-12 03:03:56,089 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, UNASSIGN 2023-02-12 03:03:56,090 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, UNASSIGN 2023-02-12 03:03:56,090 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, UNASSIGN 2023-02-12 03:03:56,090 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, UNASSIGN 2023-02-12 03:03:56,090 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, UNASSIGN 2023-02-12 03:03:56,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5256588c4e46c1ac77683a07b572a85d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4866d0a2e16b4444f70021950fd29e1c, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,090 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036090"}]},"ts":"1676171036090"} 2023-02-12 03:03:56,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171036090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036090"}]},"ts":"1676171036090"} 2023-02-12 03:03:56,090 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cde8d98d3430cca9a5979706694ddc35, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=5b0045e911fffda0ed4b1f5f6bd3bffe, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036090"}]},"ts":"1676171036090"} 2023-02-12 03:03:56,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c106a7e7ca705f10c3fedfdb7db9eb8b, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036090"}]},"ts":"1676171036090"} 2023-02-12 03:03:56,091 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171036090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036090"}]},"ts":"1676171036090"} 2023-02-12 03:03:56,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure 5256588c4e46c1ac77683a07b572a85d, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:56,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure 4866d0a2e16b4444f70021950fd29e1c, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:56,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure cde8d98d3430cca9a5979706694ddc35, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:56,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure 5b0045e911fffda0ed4b1f5f6bd3bffe, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:56,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure c106a7e7ca705f10c3fedfdb7db9eb8b, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:56,095 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, UNASSIGN 2023-02-12 03:03:56,095 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, UNASSIGN 2023-02-12 03:03:56,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=3b46456aa10812feb1bbc7b780ffcfa2, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,095 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, UNASSIGN 2023-02-12 03:03:56,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036095"}]},"ts":"1676171036095"} 2023-02-12 03:03:56,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=176457630362e278d018029d375948d6, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=10c16957f542d233830d97624ef0c296, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,096 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036096"}]},"ts":"1676171036096"} 2023-02-12 03:03:56,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036096"}]},"ts":"1676171036096"} 2023-02-12 03:03:56,097 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, UNASSIGN 2023-02-12 03:03:56,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 3b46456aa10812feb1bbc7b780ffcfa2, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:56,097 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, UNASSIGN 2023-02-12 03:03:56,097 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b38a5be7071bddacf354fee2d0f2e05d, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036097"}]},"ts":"1676171036097"} 2023-02-12 03:03:56,098 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=fdeccfa6da1f207cd7d7ef859596ca0c, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 176457630362e278d018029d375948d6, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:56,098 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171036098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171036098"}]},"ts":"1676171036098"} 2023-02-12 03:03:56,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 10c16957f542d233830d97624ef0c296, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:56,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=37, state=RUNNABLE; CloseRegionProcedure b38a5be7071bddacf354fee2d0f2e05d, server=jenkins-hbase6.apache.org,46453,1676171031117}] 2023-02-12 03:03:56,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure fdeccfa6da1f207cd7d7ef859596ca0c, server=jenkins-hbase6.apache.org,38635,1676171031086}] 2023-02-12 03:03:56,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:56,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:56,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing cde8d98d3430cca9a5979706694ddc35, disabling compactions & flushes 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 3b46456aa10812feb1bbc7b780ffcfa2, disabling compactions & flushes 2023-02-12 03:03:56,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:56,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. after waiting 0 ms 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. after waiting 0 ms 2023-02-12 03:03:56,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:56,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2. 2023-02-12 03:03:56,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35. 2023-02-12 03:03:56,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 3b46456aa10812feb1bbc7b780ffcfa2: Waiting for close lock at 1676171036245Running coprocessor pre-close hooks at 1676171036245Disabling compacts and flushes for region at 1676171036245Disabling writes for close at 1676171036245Writing region close event to WAL at 1676171036249 (+4 ms)Running coprocessor post-close hooks at 1676171036252 (+3 ms)Closed at 1676171036252 2023-02-12 03:03:56,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for cde8d98d3430cca9a5979706694ddc35: Waiting for close lock at 1676171036245Running coprocessor pre-close hooks at 1676171036245Disabling compacts and flushes for region at 1676171036245Disabling writes for close at 1676171036245Writing region close event to WAL at 1676171036249 (+4 ms)Running coprocessor post-close hooks at 1676171036252 (+3 ms)Closed at 1676171036252 2023-02-12 03:03:56,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:56,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:56,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing b38a5be7071bddacf354fee2d0f2e05d, disabling compactions & flushes 2023-02-12 03:03:56,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:56,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:56,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. after waiting 0 ms 2023-02-12 03:03:56,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:56,254 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cde8d98d3430cca9a5979706694ddc35, regionState=CLOSED 2023-02-12 03:03:56,254 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036254"}]},"ts":"1676171036254"} 2023-02-12 03:03:56,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:56,255 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=3b46456aa10812feb1bbc7b780ffcfa2, regionState=CLOSED 2023-02-12 03:03:56,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:56,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 5256588c4e46c1ac77683a07b572a85d, disabling compactions & flushes 2023-02-12 03:03:56,255 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036255"}]},"ts":"1676171036255"} 2023-02-12 03:03:56,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:56,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:56,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. after waiting 0 ms 2023-02-12 03:03:56,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:56,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d. 2023-02-12 03:03:56,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 5256588c4e46c1ac77683a07b572a85d: Waiting for close lock at 1676171036255Running coprocessor pre-close hooks at 1676171036255Disabling compacts and flushes for region at 1676171036255Disabling writes for close at 1676171036255Writing region close event to WAL at 1676171036256 (+1 ms)Running coprocessor post-close hooks at 1676171036259 (+3 ms)Closed at 1676171036259 2023-02-12 03:03:56,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:56,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:56,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 5b0045e911fffda0ed4b1f5f6bd3bffe, disabling compactions & flushes 2023-02-12 03:03:56,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:56,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:56,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. after waiting 0 ms 2023-02-12 03:03:56,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:56,261 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5256588c4e46c1ac77683a07b572a85d, regionState=CLOSED 2023-02-12 03:03:56,261 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036261"}]},"ts":"1676171036261"} 2023-02-12 03:03:56,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-12 03:03:56,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure cde8d98d3430cca9a5979706694ddc35, server=jenkins-hbase6.apache.org,46453,1676171031117 in 170 msec 2023-02-12 03:03:56,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d. 2023-02-12 03:03:56,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for b38a5be7071bddacf354fee2d0f2e05d: Waiting for close lock at 1676171036254Running coprocessor pre-close hooks at 1676171036254Disabling compacts and flushes for region at 1676171036254Disabling writes for close at 1676171036254Writing region close event to WAL at 1676171036256 (+2 ms)Running coprocessor post-close hooks at 1676171036266 (+10 ms)Closed at 1676171036266 2023-02-12 03:03:56,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe. 2023-02-12 03:03:56,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 5b0045e911fffda0ed4b1f5f6bd3bffe: Waiting for close lock at 1676171036261Running coprocessor pre-close hooks at 1676171036261Disabling compacts and flushes for region at 1676171036261Disabling writes for close at 1676171036261Writing region close event to WAL at 1676171036262 (+1 ms)Running coprocessor post-close hooks at 1676171036266 (+4 ms)Closed at 1676171036266 2023-02-12 03:03:56,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 03:03:56,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-12 03:03:56,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cde8d98d3430cca9a5979706694ddc35, UNASSIGN in 178 msec 2023-02-12 03:03:56,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure 5256588c4e46c1ac77683a07b572a85d, server=jenkins-hbase6.apache.org,38635,1676171031086 in 172 msec 2023-02-12 03:03:56,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 3b46456aa10812feb1bbc7b780ffcfa2, server=jenkins-hbase6.apache.org,38635,1676171031086 in 167 msec 2023-02-12 03:03:56,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:56,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:56,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing c106a7e7ca705f10c3fedfdb7db9eb8b, disabling compactions & flushes 2023-02-12 03:03:56,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. after waiting 0 ms 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:56,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b38a5be7071bddacf354fee2d0f2e05d, regionState=CLOSED 2023-02-12 03:03:56,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036268"}]},"ts":"1676171036268"} 2023-02-12 03:03:56,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5256588c4e46c1ac77683a07b572a85d, UNASSIGN in 180 msec 2023-02-12 03:03:56,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3b46456aa10812feb1bbc7b780ffcfa2, UNASSIGN in 180 msec 2023-02-12 03:03:56,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:56,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 10c16957f542d233830d97624ef0c296, disabling compactions & flushes 2023-02-12 03:03:56,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. after waiting 0 ms 2023-02-12 03:03:56,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:56,269 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=5b0045e911fffda0ed4b1f5f6bd3bffe, regionState=CLOSED 2023-02-12 03:03:56,269 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036269"}]},"ts":"1676171036269"} 2023-02-12 03:03:56,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:56,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b. 2023-02-12 03:03:56,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for c106a7e7ca705f10c3fedfdb7db9eb8b: Waiting for close lock at 1676171036267Running coprocessor pre-close hooks at 1676171036267Disabling compacts and flushes for region at 1676171036267Disabling writes for close at 1676171036268 (+1 ms)Writing region close event to WAL at 1676171036268Running coprocessor post-close hooks at 1676171036272 (+4 ms)Closed at 1676171036272 2023-02-12 03:03:56,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=37 2023-02-12 03:03:56,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=37, state=SUCCESS; CloseRegionProcedure b38a5be7071bddacf354fee2d0f2e05d, server=jenkins-hbase6.apache.org,46453,1676171031117 in 170 msec 2023-02-12 03:03:56,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-12 03:03:56,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure 5b0045e911fffda0ed4b1f5f6bd3bffe, server=jenkins-hbase6.apache.org,38635,1676171031086 in 176 msec 2023-02-12 03:03:56,273 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b38a5be7071bddacf354fee2d0f2e05d, UNASSIGN in 185 msec 2023-02-12 03:03:56,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:56,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:56,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 4866d0a2e16b4444f70021950fd29e1c, disabling compactions & flushes 2023-02-12 03:03:56,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:56,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:56,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5b0045e911fffda0ed4b1f5f6bd3bffe, UNASSIGN in 185 msec 2023-02-12 03:03:56,273 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c106a7e7ca705f10c3fedfdb7db9eb8b, regionState=CLOSED 2023-02-12 03:03:56,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. after waiting 0 ms 2023-02-12 03:03:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:56,274 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171036273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036273"}]},"ts":"1676171036273"} 2023-02-12 03:03:56,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296. 2023-02-12 03:03:56,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 10c16957f542d233830d97624ef0c296: Waiting for close lock at 1676171036268Running coprocessor pre-close hooks at 1676171036268Disabling compacts and flushes for region at 1676171036268Disabling writes for close at 1676171036268Writing region close event to WAL at 1676171036270 (+2 ms)Running coprocessor post-close hooks at 1676171036275 (+5 ms)Closed at 1676171036275 2023-02-12 03:03:56,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 10c16957f542d233830d97624ef0c296 2023-02-12 03:03:56,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:56,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing fdeccfa6da1f207cd7d7ef859596ca0c, disabling compactions & flushes 2023-02-12 03:03:56,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:56,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:56,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. after waiting 0 ms 2023-02-12 03:03:56,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:56,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-12 03:03:56,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=10c16957f542d233830d97624ef0c296, regionState=CLOSED 2023-02-12 03:03:56,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure c106a7e7ca705f10c3fedfdb7db9eb8b, server=jenkins-hbase6.apache.org,46453,1676171031117 in 181 msec 2023-02-12 03:03:56,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036276"}]},"ts":"1676171036276"} 2023-02-12 03:03:56,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:03:56,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c. 2023-02-12 03:03:56,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 4866d0a2e16b4444f70021950fd29e1c: Waiting for close lock at 1676171036273Running coprocessor pre-close hooks at 1676171036273Disabling compacts and flushes for region at 1676171036273Disabling writes for close at 1676171036274 (+1 ms)Writing region close event to WAL at 1676171036274Running coprocessor post-close hooks at 1676171036277 (+3 ms)Closed at 1676171036277 2023-02-12 03:03:56,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c106a7e7ca705f10c3fedfdb7db9eb8b, UNASSIGN in 189 msec 2023-02-12 03:03:56,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:56,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close 176457630362e278d018029d375948d6 2023-02-12 03:03:56,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 176457630362e278d018029d375948d6, disabling compactions & flushes 2023-02-12 03:03:56,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:56,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:56,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. after waiting 0 ms 2023-02-12 03:03:56,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:56,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4866d0a2e16b4444f70021950fd29e1c, regionState=CLOSED 2023-02-12 03:03:56,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676171036279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036279"}]},"ts":"1676171036279"} 2023-02-12 03:03:56,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-12 03:03:56,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 10c16957f542d233830d97624ef0c296, server=jenkins-hbase6.apache.org,38635,1676171031086 in 179 msec 2023-02-12 03:03:56,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=10c16957f542d233830d97624ef0c296, UNASSIGN in 193 msec 2023-02-12 03:03:56,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-12 03:03:56,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure 4866d0a2e16b4444f70021950fd29e1c, server=jenkins-hbase6.apache.org,46453,1676171031117 in 188 msec 2023-02-12 03:03:56,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4866d0a2e16b4444f70021950fd29e1c, UNASSIGN in 195 msec 2023-02-12 03:03:56,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6. 2023-02-12 03:03:56,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 176457630362e278d018029d375948d6: Waiting for close lock at 1676171036279Running coprocessor pre-close hooks at 1676171036279Disabling compacts and flushes for region at 1676171036279Disabling writes for close at 1676171036279Writing region close event to WAL at 1676171036281 (+2 ms)Running coprocessor post-close hooks at 1676171036284 (+3 ms)Closed at 1676171036284 2023-02-12 03:03:56,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed 176457630362e278d018029d375948d6 2023-02-12 03:03:56,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=176457630362e278d018029d375948d6, regionState=CLOSED 2023-02-12 03:03:56,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036286"}]},"ts":"1676171036286"} 2023-02-12 03:03:56,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 03:03:56,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 176457630362e278d018029d375948d6, server=jenkins-hbase6.apache.org,46453,1676171031117 in 189 msec 2023-02-12 03:03:56,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=176457630362e278d018029d375948d6, UNASSIGN in 201 msec 2023-02-12 03:03:56,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:03:56,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c. 2023-02-12 03:03:56,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for fdeccfa6da1f207cd7d7ef859596ca0c: Waiting for close lock at 1676171036276Running coprocessor pre-close hooks at 1676171036276Disabling compacts and flushes for region at 1676171036276Disabling writes for close at 1676171036276Writing region close event to WAL at 1676171036278 (+2 ms)Running coprocessor post-close hooks at 1676171036291 (+13 ms)Closed at 1676171036291 2023-02-12 03:03:56,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:56,293 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=fdeccfa6da1f207cd7d7ef859596ca0c, regionState=CLOSED 2023-02-12 03:03:56,293 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676171036293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171036293"}]},"ts":"1676171036293"} 2023-02-12 03:03:56,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-12 03:03:56,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure fdeccfa6da1f207cd7d7ef859596ca0c, server=jenkins-hbase6.apache.org,38635,1676171031086 in 191 msec 2023-02-12 03:03:56,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-12 03:03:56,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=fdeccfa6da1f207cd7d7ef859596ca0c, UNASSIGN in 208 msec 2023-02-12 03:03:56,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171036296"}]},"ts":"1676171036296"} 2023-02-12 03:03:56,297 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-12 03:03:56,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:56,356 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-12 03:03:56,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 358 msec 2023-02-12 03:03:56,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 03:03:56,607 INFO [Listener at localhost/36779] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-12 03:03:56,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:56,620 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:56,624 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/recovered.edits] 2023-02-12 03:03:56,624 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/recovered.edits] 2023-02-12 03:03:56,624 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/recovered.edits] 2023-02-12 03:03:56,624 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/recovered.edits] 2023-02-12 03:03:56,625 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/recovered.edits] 2023-02-12 03:03:56,625 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/recovered.edits] 2023-02-12 03:03:56,625 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/recovered.edits] 2023-02-12 03:03:56,626 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/recovered.edits] 2023-02-12 03:03:56,631 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/e130f2fad370472faf6cf757d25919bf 2023-02-12 03:03:56,632 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/435f6e6500cf48b2b2cf82af1dc939ed 2023-02-12 03:03:56,633 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/7d75663ed8f24c3ea689bf6242d4edf7 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/7d75663ed8f24c3ea689bf6242d4edf7 2023-02-12 03:03:56,633 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/3ddb4fd41359465dad6455fa797367dc 2023-02-12 03:03:56,633 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/30336b4c903642d4bde1e8464f42cd0a 2023-02-12 03:03:56,633 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/f4768612f9804161b7aedfa659cb7a57 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f1/f4768612f9804161b7aedfa659cb7a57 2023-02-12 03:03:56,634 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/7194c15efad54cdeabc079f2ce1c5c2f to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/7194c15efad54cdeabc079f2ce1c5c2f 2023-02-12 03:03:56,635 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/390a9618bc2f4ee2845c7ce1b58528da to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/390a9618bc2f4ee2845c7ce1b58528da 2023-02-12 03:03:56,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/e3990254269e404da8c11d7146b68a02 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f1/e3990254269e404da8c11d7146b68a02 2023-02-12 03:03:56,635 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/7b33f10d757e41fbab1ca2daf8c32009 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f1/7b33f10d757e41fbab1ca2daf8c32009 2023-02-12 03:03:56,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f1/97f67898267f4a7aa59917d9ddcd9362 2023-02-12 03:03:56,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/5918c77565b5417faea3e20997c0e48e to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f1/5918c77565b5417faea3e20997c0e48e 2023-02-12 03:03:56,636 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/recovered.edits/6.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c/recovered.edits/6.seqid 2023-02-12 03:03:56,637 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f1/f9894f7cdb7c4390ab4499605cebdfef 2023-02-12 03:03:56,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/4866d0a2e16b4444f70021950fd29e1c 2023-02-12 03:03:56,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:56,637 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f1/ac8069fb96db4afdadcd52d6ae56d651 2023-02-12 03:03:56,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/0448aff292d140d181281c3e279d98dd to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/0448aff292d140d181281c3e279d98dd 2023-02-12 03:03:56,643 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/6d68a84f6099462980737e1193a30007 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/6d68a84f6099462980737e1193a30007 2023-02-12 03:03:56,643 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/recovered.edits] 2023-02-12 03:03:56,644 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/302674bd7c8f4129bf91f5c43f40a611 2023-02-12 03:03:56,644 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/194cf8b3be944698a7169d85c45a07b9 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/194cf8b3be944698a7169d85c45a07b9 2023-02-12 03:03:56,644 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d4dc218aec94444e911fdba4ec560797 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d4dc218aec94444e911fdba4ec560797 2023-02-12 03:03:56,645 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/41fdb870baaa43edbf3d7b933963cf73 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/41fdb870baaa43edbf3d7b933963cf73 2023-02-12 03:03:56,645 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/f2/f8410655d40e44cdb687ac4d1cab1d1f 2023-02-12 03:03:56,645 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/783c64a3c523486d8b6745de90526045 2023-02-12 03:03:56,645 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/f2/980ec6940d87402db7d112a7343f7f0a 2023-02-12 03:03:56,646 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/67ab55f7613349ad89304afa00dfb649 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/f2/67ab55f7613349ad89304afa00dfb649 2023-02-12 03:03:56,647 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/f2/d5d60d552d664f68a5426ed6d61872d9 2023-02-12 03:03:56,648 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/f2/c359a27d10c64f1cb4f92d02f9473dde 2023-02-12 03:03:56,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/d2224a9d10424215b4e02142d3847e74 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/f2/d2224a9d10424215b4e02142d3847e74 2023-02-12 03:03:56,648 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/f2/97e4b2496d7d433896e3bc208775e152 2023-02-12 03:03:56,653 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d/recovered.edits/12.seqid 2023-02-12 03:03:56,653 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296/recovered.edits/12.seqid 2023-02-12 03:03:56,653 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/9ae76805493d4c0a92b73f846eec830b 2023-02-12 03:03:56,654 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5256588c4e46c1ac77683a07b572a85d 2023-02-12 03:03:56,654 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:56,655 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/10c16957f542d233830d97624ef0c296 2023-02-12 03:03:56,656 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c/recovered.edits/12.seqid 2023-02-12 03:03:56,656 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe/recovered.edits/12.seqid 2023-02-12 03:03:56,656 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35/recovered.edits/12.seqid 2023-02-12 03:03:56,656 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/fbde05aab5e24cfcb053c79b8cbe8f18 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f1/fbde05aab5e24cfcb053c79b8cbe8f18 2023-02-12 03:03:56,657 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/fdeccfa6da1f207cd7d7ef859596ca0c 2023-02-12 03:03:56,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f1, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/f2, FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/recovered.edits] 2023-02-12 03:03:56,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/cde8d98d3430cca9a5979706694ddc35 2023-02-12 03:03:56,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/5b0045e911fffda0ed4b1f5f6bd3bffe 2023-02-12 03:03:56,658 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d/recovered.edits/12.seqid 2023-02-12 03:03:56,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6/recovered.edits/12.seqid 2023-02-12 03:03:56,659 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/b38a5be7071bddacf354fee2d0f2e05d 2023-02-12 03:03:56,659 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/176457630362e278d018029d375948d6 2023-02-12 03:03:56,661 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/03a9d04694c54c718d04ad4eee8d8bbb 2023-02-12 03:03:56,662 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/9a093faacc014cd0b5e9f3dec4c378e5 to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/f2/9a093faacc014cd0b5e9f3dec4c378e5 2023-02-12 03:03:56,663 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/recovered.edits/6.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b/recovered.edits/6.seqid 2023-02-12 03:03:56,664 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/c106a7e7ca705f10c3fedfdb7db9eb8b 2023-02-12 03:03:56,665 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/recovered.edits/12.seqid to hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/archive/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2/recovered.edits/12.seqid 2023-02-12 03:03:56,666 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/.tmp/data/default/testWithMockedMapReduceMultiRegion/3b46456aa10812feb1bbc7b780ffcfa2 2023-02-12 03:03:56,666 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 03:03:56,668 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,671 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-12 03:03:56,676 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,677 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676171032356.10c16957f542d233830d97624ef0c296.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171036677"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 03:03:56,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4866d0a2e16b4444f70021950fd29e1c, NAME => 'testWithMockedMapReduceMultiRegion,,1676171032356.4866d0a2e16b4444f70021950fd29e1c.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 5256588c4e46c1ac77683a07b572a85d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676171032356.5256588c4e46c1ac77683a07b572a85d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => fdeccfa6da1f207cd7d7ef859596ca0c, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676171032356.fdeccfa6da1f207cd7d7ef859596ca0c.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => b38a5be7071bddacf354fee2d0f2e05d, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676171032356.b38a5be7071bddacf354fee2d0f2e05d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => cde8d98d3430cca9a5979706694ddc35, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676171032356.cde8d98d3430cca9a5979706694ddc35.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 5b0045e911fffda0ed4b1f5f6bd3bffe, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676171032356.5b0045e911fffda0ed4b1f5f6bd3bffe.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 10c16957f542d233830d97624ef0c296, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676171032356.10c16957f542d233830d97624ef0c296.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 176457630362e278d018029d375948d6, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676171032356.176457630362e278d018029d375948d6.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 3b46456aa10812feb1bbc7b780ffcfa2, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676171032356.3b46456aa10812feb1bbc7b780ffcfa2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => c106a7e7ca705f10c3fedfdb7db9eb8b, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676171032356.c106a7e7ca705f10c3fedfdb7db9eb8b.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 03:03:56,680 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-12 03:03:56,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171036680"}]},"ts":"9223372036854775807"} 2023-02-12 03:03:56,681 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-12 03:03:56,710 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 03:03:56,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 103 msec 2023-02-12 03:03:56,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40971] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 03:03:56,712 INFO [Listener at localhost/36779] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-12 03:03:56,712 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:03:56,712 INFO [Listener at localhost/36779] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:03:56,713 DEBUG [Listener at localhost/36779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x464291b2 to 127.0.0.1:55495 2023-02-12 03:03:56,713 DEBUG [Listener at localhost/36779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,713 DEBUG [Listener at localhost/36779] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:03:56,713 DEBUG [Listener at localhost/36779] util.JVMClusterUtil(257): Found active master hash=1180284139, stopped=false 2023-02-12 03:03:56,713 INFO [Listener at localhost/36779] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:56,756 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:56,756 INFO [Listener at localhost/36779] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:03:56,756 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:56,756 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:56,756 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:56,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:56,758 DEBUG [Listener at localhost/36779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e4a86de to 127.0.0.1:55495 2023-02-12 03:03:56,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:56,758 DEBUG [Listener at localhost/36779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:56,758 INFO [Listener at localhost/36779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,38635,1676171031086' ***** 2023-02-12 03:03:56,758 INFO [Listener at localhost/36779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:56,758 INFO [Listener at localhost/36779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,46453,1676171031117' ***** 2023-02-12 03:03:56,759 INFO [Listener at localhost/36779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:03:56,759 INFO [RS:0;jenkins-hbase6:38635] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:56,759 INFO [RS:1;jenkins-hbase6:46453] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:03:56,759 INFO [RS:1;jenkins-hbase6:46453] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:56,759 INFO [RS:1;jenkins-hbase6:46453] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:56,759 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:56,759 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(3304): Received CLOSE for de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:56,759 INFO [RS:0;jenkins-hbase6:38635] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:03:56,760 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,759 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:03:56,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing de5599041d57a9fc9513baf36d31bfb2, disabling compactions & flushes 2023-02-12 03:03:56,760 DEBUG [RS:1;jenkins-hbase6:46453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x147a0066 to 127.0.0.1:55495 2023-02-12 03:03:56,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:56,760 INFO [RS:0;jenkins-hbase6:38635] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:03:56,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:56,762 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,762 DEBUG [RS:1;jenkins-hbase6:46453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,762 DEBUG [RS:0;jenkins-hbase6:38635] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674e527b to 127.0.0.1:55495 2023-02-12 03:03:56,762 INFO [RS:1;jenkins-hbase6:46453] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:56,762 INFO [RS:1;jenkins-hbase6:46453] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:56,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. after waiting 0 ms 2023-02-12 03:03:56,762 INFO [RS:1;jenkins-hbase6:46453] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:56,762 DEBUG [RS:0;jenkins-hbase6:38635] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,762 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:03:56,763 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,38635,1676171031086; all regions closed. 2023-02-12 03:03:56,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:56,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing de5599041d57a9fc9513baf36d31bfb2 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:03:56,763 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 03:03:56,763 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, de5599041d57a9fc9513baf36d31bfb2=hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2.} 2023-02-12 03:03:56,763 DEBUG [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1505): Waiting on 1588230740, de5599041d57a9fc9513baf36d31bfb2 2023-02-12 03:03:56,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:56,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:56,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:56,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:56,766 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:56,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-12 03:03:56,770 DEBUG [RS:0;jenkins-hbase6:38635] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs 2023-02-12 03:03:56,770 INFO [RS:0;jenkins-hbase6:38635] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C38635%2C1676171031086:(num 1676171032438) 2023-02-12 03:03:56,770 DEBUG [RS:0;jenkins-hbase6:38635] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,770 INFO [RS:0;jenkins-hbase6:38635] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:56,771 INFO [RS:0;jenkins-hbase6:38635] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:56,771 INFO [RS:0;jenkins-hbase6:38635] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:03:56,771 INFO [RS:0;jenkins-hbase6:38635] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:03:56,771 INFO [RS:0;jenkins-hbase6:38635] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:03:56,771 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:56,772 INFO [RS:0;jenkins-hbase6:38635] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:38635 2023-02-12 03:03:56,779 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,779 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:56,779 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:56,779 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,38635,1676171031086 2023-02-12 03:03:56,782 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b96595 rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:56,782 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:56,782 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bd1147e rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:56,783 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,38635,1676171031086] 2023-02-12 03:03:56,783 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,38635,1676171031086; numProcessing=1 2023-02-12 03:03:56,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/.tmp/info/b29acbefd44942aaabc7a4957283d169 2023-02-12 03:03:56,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/info/791cee8e29f04cdba32ff8e1a161d79f 2023-02-12 03:03:56,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/.tmp/info/b29acbefd44942aaabc7a4957283d169 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/info/b29acbefd44942aaabc7a4957283d169 2023-02-12 03:03:56,791 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 791cee8e29f04cdba32ff8e1a161d79f 2023-02-12 03:03:56,794 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,38635,1676171031086 already deleted, retry=false 2023-02-12 03:03:56,794 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,38635,1676171031086 expired; onlineServers=1 2023-02-12 03:03:56,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/info/b29acbefd44942aaabc7a4957283d169, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:03:56,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for de5599041d57a9fc9513baf36d31bfb2 in 33ms, sequenceid=6, compaction requested=false 2023-02-12 03:03:56,803 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:56,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/namespace/de5599041d57a9fc9513baf36d31bfb2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:03:56,808 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:56,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:56,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for de5599041d57a9fc9513baf36d31bfb2: Waiting for close lock at 1676171036760Running coprocessor pre-close hooks at 1676171036760Disabling compacts and flushes for region at 1676171036760Disabling writes for close at 1676171036762 (+2 ms)Obtaining lock to block concurrent updates at 1676171036763 (+1 ms)Preparing flush snapshotting stores in de5599041d57a9fc9513baf36d31bfb2 at 1676171036763Finished memstore snapshotting hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171036766 (+3 ms)Flushing stores of hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. at 1676171036766Flushing de5599041d57a9fc9513baf36d31bfb2/info: creating writer at 1676171036766Flushing de5599041d57a9fc9513baf36d31bfb2/info: appending metadata at 1676171036769 (+3 ms)Flushing de5599041d57a9fc9513baf36d31bfb2/info: closing flushed file at 1676171036769Flushing de5599041d57a9fc9513baf36d31bfb2/info: reopening flushed file at 1676171036791 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for de5599041d57a9fc9513baf36d31bfb2 in 33ms, sequenceid=6, compaction requested=false at 1676171036796 (+5 ms)Writing region close event to WAL at 1676171036801 (+5 ms)Running coprocessor post-close hooks at 1676171036809 (+8 ms)Closed at 1676171036810 (+1 ms) 2023-02-12 03:03:56,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171031719.de5599041d57a9fc9513baf36d31bfb2. 2023-02-12 03:03:56,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/rep_barrier/f46ac703189645998ecc118b44190316 2023-02-12 03:03:56,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f46ac703189645998ecc118b44190316 2023-02-12 03:03:56,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/table/d4a2cc68d6d04b16bb4e3ee1330fc3d2 2023-02-12 03:03:56,830 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4a2cc68d6d04b16bb4e3ee1330fc3d2 2023-02-12 03:03:56,831 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/info/791cee8e29f04cdba32ff8e1a161d79f as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/info/791cee8e29f04cdba32ff8e1a161d79f 2023-02-12 03:03:56,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 791cee8e29f04cdba32ff8e1a161d79f 2023-02-12 03:03:56,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/info/791cee8e29f04cdba32ff8e1a161d79f, entries=30, sequenceid=57, filesize=8.3 K 2023-02-12 03:03:56,836 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/rep_barrier/f46ac703189645998ecc118b44190316 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/rep_barrier/f46ac703189645998ecc118b44190316 2023-02-12 03:03:56,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f46ac703189645998ecc118b44190316 2023-02-12 03:03:56,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/rep_barrier/f46ac703189645998ecc118b44190316, entries=10, sequenceid=57, filesize=6.1 K 2023-02-12 03:03:56,840 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/.tmp/table/d4a2cc68d6d04b16bb4e3ee1330fc3d2 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/table/d4a2cc68d6d04b16bb4e3ee1330fc3d2 2023-02-12 03:03:56,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4a2cc68d6d04b16bb4e3ee1330fc3d2 2023-02-12 03:03:56,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/table/d4a2cc68d6d04b16bb4e3ee1330fc3d2, entries=13, sequenceid=57, filesize=6.1 K 2023-02-12 03:03:56,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=57, compaction requested=false 2023-02-12 03:03:56,849 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 03:03:56,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:56,850 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:56,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171036763Running coprocessor pre-close hooks at 1676171036763Disabling compacts and flushes for region at 1676171036763Disabling writes for close at 1676171036766 (+3 ms)Obtaining lock to block concurrent updates at 1676171036766Preparing flush snapshotting stores in 1588230740 at 1676171036766Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676171036766Flushing stores of hbase:meta,,1.1588230740 at 1676171036767 (+1 ms)Flushing 1588230740/info: creating writer at 1676171036767Flushing 1588230740/info: appending metadata at 1676171036771 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676171036771Flushing 1588230740/rep_barrier: creating writer at 1676171036792 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171036794 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171036794Flushing 1588230740/table: creating writer at 1676171036814 (+20 ms)Flushing 1588230740/table: appending metadata at 1676171036816 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676171036816Flushing 1588230740/info: reopening flushed file at 1676171036832 (+16 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171036836 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676171036842 (+6 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=57, compaction requested=false at 1676171036846 (+4 ms)Writing region close event to WAL at 1676171036847 (+1 ms)Running coprocessor post-close hooks at 1676171036850 (+3 ms)Closed at 1676171036850 2023-02-12 03:03:56,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:56,941 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:56,941 INFO [RS:0;jenkins-hbase6:38635] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,38635,1676171031086; zookeeper connection closed. 2023-02-12 03:03:56,941 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43b66e26 rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:56,941 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:38635-0x10154e966320001, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:56,941 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d6bf60c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d6bf60c 2023-02-12 03:03:56,941 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@146a028e rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:56,966 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,46453,1676171031117; all regions closed. 2023-02-12 03:03:56,969 DEBUG [RS:1;jenkins-hbase6:46453] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs 2023-02-12 03:03:56,969 INFO [RS:1;jenkins-hbase6:46453] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46453%2C1676171031117.meta:.meta(num 1676171031656) 2023-02-12 03:03:56,973 DEBUG [RS:1;jenkins-hbase6:46453] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/oldWALs 2023-02-12 03:03:56,973 INFO [RS:1;jenkins-hbase6:46453] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46453%2C1676171031117:(num 1676171032088) 2023-02-12 03:03:56,973 DEBUG [RS:1;jenkins-hbase6:46453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,973 INFO [RS:1;jenkins-hbase6:46453] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:03:56,973 INFO [RS:1;jenkins-hbase6:46453] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:03:56,973 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:56,975 INFO [RS:1;jenkins-hbase6:46453] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46453 2023-02-12 03:03:56,978 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46453,1676171031117 2023-02-12 03:03:56,978 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:56,978 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47dc0a0a rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:56,979 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,46453,1676171031117] 2023-02-12 03:03:56,979 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,46453,1676171031117; numProcessing=2 2023-02-12 03:03:56,980 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,46453,1676171031117 already deleted, retry=false 2023-02-12 03:03:56,980 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,46453,1676171031117 expired; onlineServers=0 2023-02-12 03:03:56,980 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,40971,1676171031042' ***** 2023-02-12 03:03:56,980 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:03:56,981 DEBUG [M:0;jenkins-hbase6:40971] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426628f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:56,981 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,40971,1676171031042 2023-02-12 03:03:56,981 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,40971,1676171031042; all regions closed. 2023-02-12 03:03:56,981 DEBUG [M:0;jenkins-hbase6:40971] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:03:56,981 DEBUG [M:0;jenkins-hbase6:40971] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:03:56,981 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:03:56,981 DEBUG [M:0;jenkins-hbase6:40971] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:03:56,981 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171031293] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171031293,5,FailOnTimeoutGroup] 2023-02-12 03:03:56,981 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171031293] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171031293,5,FailOnTimeoutGroup] 2023-02-12 03:03:56,981 INFO [M:0;jenkins-hbase6:40971] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:03:56,983 INFO [M:0;jenkins-hbase6:40971] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:03:56,983 INFO [M:0;jenkins-hbase6:40971] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:03:56,983 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:56,983 DEBUG [M:0;jenkins-hbase6:40971] master.HMaster(1502): Stopping service threads 2023-02-12 03:03:56,983 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:56,983 INFO [M:0;jenkins-hbase6:40971] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:03:56,984 ERROR [M:0;jenkins-hbase6:40971] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:03:56,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:56,984 INFO [M:0;jenkins-hbase6:40971] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:03:56,984 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:03:56,984 DEBUG [M:0;jenkins-hbase6:40971] zookeeper.ZKUtil(398): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:03:56,984 WARN [M:0;jenkins-hbase6:40971] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:03:56,984 INFO [M:0;jenkins-hbase6:40971] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:03:56,985 INFO [M:0;jenkins-hbase6:40971] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:03:56,985 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:56,985 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:56,985 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:56,985 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:56,985 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:56,985 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-12 03:03:56,997 INFO [M:0;jenkins-hbase6:40971] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/98cb0af675d440ada69d1c9fd97fd189 2023-02-12 03:03:57,001 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/98cb0af675d440ada69d1c9fd97fd189 as hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/98cb0af675d440ada69d1c9fd97fd189 2023-02-12 03:03:57,005 INFO [M:0;jenkins-hbase6:40971] regionserver.HStore(1080): Added hdfs://localhost:41745/user/jenkins/test-data/8ef89a83-b32e-7920-371d-bdaa80f46c1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/98cb0af675d440ada69d1c9fd97fd189, entries=53, sequenceid=357, filesize=10.7 K 2023-02-12 03:03:57,006 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171131, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=357, compaction requested=false 2023-02-12 03:03:57,006 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:57,006 DEBUG [M:0;jenkins-hbase6:40971] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171036985Disabling compacts and flushes for region at 1676171036985Disabling writes for close at 1676171036985Obtaining lock to block concurrent updates at 1676171036985Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171036985Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171131, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676171036985Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171036986 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171036987 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171036989 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171036989Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171037002 (+13 ms)Finished flush of dataSize ~167.12 KB/171131, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=357, compaction requested=false at 1676171037006 (+4 ms)Writing region close event to WAL at 1676171037006Closed at 1676171037006 2023-02-12 03:03:57,009 INFO [M:0;jenkins-hbase6:40971] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:03:57,009 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:03:57,010 INFO [M:0;jenkins-hbase6:40971] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:40971 2023-02-12 03:03:57,013 DEBUG [M:0;jenkins-hbase6:40971] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,40971,1676171031042 already deleted, retry=false 2023-02-12 03:03:57,178 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:03:57,344 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:57,344 INFO [M:0;jenkins-hbase6:40971] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,40971,1676171031042; zookeeper connection closed. 2023-02-12 03:03:57,344 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3871c6ec rejected from java.util.concurrent.ThreadPoolExecutor@3c4e553a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:57,345 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): master:40971-0x10154e966320000, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:57,345 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e8ff9da rejected from java.util.concurrent.ThreadPoolExecutor@3c4e553a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:57,444 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:57,444 INFO [RS:1;jenkins-hbase6:46453] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,46453,1676171031117; zookeeper connection closed. 2023-02-12 03:03:57,444 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10865491 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:57,444 DEBUG [Listener at localhost/36779-EventThread] zookeeper.ZKWatcher(600): regionserver:46453-0x10154e966320002, quorum=127.0.0.1:55495, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:03:57,444 ERROR [Listener at localhost/36779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68208ac3 rejected from java.util.concurrent.ThreadPoolExecutor@43e38629[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:03:57,444 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@19533138] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@19533138 2023-02-12 03:03:57,445 INFO [Listener at localhost/36779] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:03:57,446 WARN [Listener at localhost/36779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:57,449 INFO [Listener at localhost/36779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:57,561 WARN [BP-1666697438-172.31.2.20-1676171030459 heartbeating to localhost/127.0.0.1:41745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:57,561 WARN [BP-1666697438-172.31.2.20-1676171030459 heartbeating to localhost/127.0.0.1:41745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1666697438-172.31.2.20-1676171030459 (Datanode Uuid ddf2c6b2-08bd-4987-97a7-1352732c3b30) service to localhost/127.0.0.1:41745 2023-02-12 03:03:57,562 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/dfs/data/data3/current/BP-1666697438-172.31.2.20-1676171030459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:57,562 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/dfs/data/data4/current/BP-1666697438-172.31.2.20-1676171030459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:57,563 WARN [Listener at localhost/36779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:03:57,568 INFO [Listener at localhost/36779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:57,675 WARN [BP-1666697438-172.31.2.20-1676171030459 heartbeating to localhost/127.0.0.1:41745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:03:57,675 WARN [BP-1666697438-172.31.2.20-1676171030459 heartbeating to localhost/127.0.0.1:41745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1666697438-172.31.2.20-1676171030459 (Datanode Uuid 4c1c50d5-e8a5-4a6d-825c-1eb2b0af0202) service to localhost/127.0.0.1:41745 2023-02-12 03:03:57,676 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/dfs/data/data1/current/BP-1666697438-172.31.2.20-1676171030459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:57,676 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/cluster_70742230-05e0-4c9c-fe7b-f0ec3e9d95cb/dfs/data/data2/current/BP-1666697438-172.31.2.20-1676171030459] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:03:57,685 INFO [Listener at localhost/36779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:03:57,805 INFO [Listener at localhost/36779] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:03:57,844 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:03:57,859 INFO [Listener at localhost/36779] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 181) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:41745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:41745 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:41745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:41745 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,40971,1676171031042)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:41745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:41745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36779.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=634 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 242) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5398 (was 5452) 2023-02-12 03:03:57,869 INFO [Listener at localhost/36779] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=167, AvailableMemoryMB=5398 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.log.dir so I do NOT create it in target/test-data/41e89460-d850-c372-70a3-68a21f313b9d 2023-02-12 03:03:57,880 WARN [Listener at localhost/36779] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.tmp.dir so I do NOT create it in target/test-data/41e89460-d850-c372-70a3-68a21f313b9d 2023-02-12 03:03:57,880 WARN [Listener at localhost/36779] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd034a8c-dd39-1a91-71c1-539987f52d4f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:03:57,880 DEBUG [Listener at localhost/36779] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73, deleteOnExit=true 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:03:57,880 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/test.cache.data in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:03:57,881 DEBUG [Listener at localhost/36779] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:03:57,881 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:03:57,882 INFO [Listener at localhost/36779] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:03:57,886 WARN [Listener at localhost/36779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:57,886 WARN [Listener at localhost/36779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:57,926 WARN [Listener at localhost/36779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:57,929 INFO [Listener at localhost/36779] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:57,933 INFO [Listener at localhost/36779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/java.io.tmpdir/Jetty_localhost_32813_hdfs____74lf7p/webapp 2023-02-12 03:03:58,034 INFO [Listener at localhost/36779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32813 2023-02-12 03:03:58,039 WARN [Listener at localhost/36779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:03:58,039 WARN [Listener at localhost/36779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:03:58,087 WARN [Listener at localhost/34773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:58,102 WARN [Listener at localhost/34773] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:58,106 WARN [Listener at localhost/34773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:58,107 INFO [Listener at localhost/34773] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:58,112 INFO [Listener at localhost/34773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/java.io.tmpdir/Jetty_localhost_36903_datanode____7vaa00/webapp 2023-02-12 03:03:58,203 INFO [Listener at localhost/34773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36903 2023-02-12 03:03:58,218 WARN [Listener at localhost/38085] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:58,237 WARN [Listener at localhost/38085] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:03:58,240 WARN [Listener at localhost/38085] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:03:58,240 INFO [Listener at localhost/38085] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:03:58,244 INFO [Listener at localhost/38085] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/java.io.tmpdir/Jetty_localhost_34585_datanode____.9i550o/webapp 2023-02-12 03:03:58,331 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x849c68792851488d: Processing first storage report for DS-42545018-a3d8-4575-8735-45fb27a23581 from datanode e8bbcee8-3109-4b5b-81e2-fa3b9a9ebb35 2023-02-12 03:03:58,331 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x849c68792851488d: from storage DS-42545018-a3d8-4575-8735-45fb27a23581 node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=e8bbcee8-3109-4b5b-81e2-fa3b9a9ebb35, infoPort=44945, infoSecurePort=0, ipcPort=38085, storageInfo=lv=-57;cid=testClusterID;nsid=488914046;c=1676171037889), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:58,331 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x849c68792851488d: Processing first storage report for DS-35f8200b-2198-4401-add0-afed7f755ea0 from datanode e8bbcee8-3109-4b5b-81e2-fa3b9a9ebb35 2023-02-12 03:03:58,331 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x849c68792851488d: from storage DS-35f8200b-2198-4401-add0-afed7f755ea0 node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=e8bbcee8-3109-4b5b-81e2-fa3b9a9ebb35, infoPort=44945, infoSecurePort=0, ipcPort=38085, storageInfo=lv=-57;cid=testClusterID;nsid=488914046;c=1676171037889), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:58,352 INFO [Listener at localhost/38085] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34585 2023-02-12 03:03:58,362 WARN [Listener at localhost/37931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:03:58,463 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2bcdf4d2c05b5ce: Processing first storage report for DS-27a0aba0-a57e-4081-a57f-aa177fad25d8 from datanode 44ffcc48-2e00-4ae7-a7a7-09253463694e 2023-02-12 03:03:58,463 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2bcdf4d2c05b5ce: from storage DS-27a0aba0-a57e-4081-a57f-aa177fad25d8 node DatanodeRegistration(127.0.0.1:34423, datanodeUuid=44ffcc48-2e00-4ae7-a7a7-09253463694e, infoPort=46869, infoSecurePort=0, ipcPort=37931, storageInfo=lv=-57;cid=testClusterID;nsid=488914046;c=1676171037889), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:58,463 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2bcdf4d2c05b5ce: Processing first storage report for DS-827ff307-d93e-48ef-a2b0-76ca93861b85 from datanode 44ffcc48-2e00-4ae7-a7a7-09253463694e 2023-02-12 03:03:58,463 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2bcdf4d2c05b5ce: from storage DS-827ff307-d93e-48ef-a2b0-76ca93861b85 node DatanodeRegistration(127.0.0.1:34423, datanodeUuid=44ffcc48-2e00-4ae7-a7a7-09253463694e, infoPort=46869, infoSecurePort=0, ipcPort=37931, storageInfo=lv=-57;cid=testClusterID;nsid=488914046;c=1676171037889), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:03:58,469 DEBUG [Listener at localhost/37931] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d 2023-02-12 03:03:58,470 INFO [Listener at localhost/37931] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/zookeeper_0, clientPort=60941, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:03:58,472 INFO [Listener at localhost/37931] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60941 2023-02-12 03:03:58,472 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,473 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,484 INFO [Listener at localhost/37931] util.FSUtils(479): Created version file at hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd with version=8 2023-02-12 03:03:58,485 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,485 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,486 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/hbase-staging 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:58,488 INFO [Listener at localhost/37931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:58,489 INFO [Listener at localhost/37931] ipc.NettyRpcServer(120): Bind to /172.31.2.20:33459 2023-02-12 03:03:58,489 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,490 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,491 INFO [Listener at localhost/37931] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33459 connecting to ZooKeeper ensemble=127.0.0.1:60941 2023-02-12 03:03:58,498 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:334590x0, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:58,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33459-0x10154e9834b0000 connected 2023-02-12 03:03:58,517 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:58,517 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:58,518 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:58,518 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-12 03:03:58,518 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33459 2023-02-12 03:03:58,522 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33459 2023-02-12 03:03:58,526 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-12 03:03:58,526 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33459 2023-02-12 03:03:58,526 INFO [Listener at localhost/37931] master.HMaster(439): hbase.rootdir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd, hbase.cluster.distributed=false 2023-02-12 03:03:58,539 INFO [Listener at localhost/37931] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:58,539 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,539 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,539 INFO [Listener at localhost/37931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:58,539 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,540 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:58,540 INFO [Listener at localhost/37931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:58,542 INFO [Listener at localhost/37931] ipc.NettyRpcServer(120): Bind to /172.31.2.20:33689 2023-02-12 03:03:58,543 INFO [Listener at localhost/37931] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:58,545 DEBUG [Listener at localhost/37931] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:58,545 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,546 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,547 INFO [Listener at localhost/37931] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33689 connecting to ZooKeeper ensemble=127.0.0.1:60941 2023-02-12 03:03:58,550 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:336890x0, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:58,551 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:336890x0, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:58,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33689-0x10154e9834b0001 connected 2023-02-12 03:03:58,552 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:58,552 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:58,554 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33689 2023-02-12 03:03:58,555 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33689 2023-02-12 03:03:58,558 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33689 2023-02-12 03:03:58,558 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33689 2023-02-12 03:03:58,562 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33689 2023-02-12 03:03:58,573 INFO [Listener at localhost/37931] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:03:58,573 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,573 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,573 INFO [Listener at localhost/37931] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:03:58,574 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:03:58,574 INFO [Listener at localhost/37931] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:03:58,574 INFO [Listener at localhost/37931] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:03:58,574 INFO [Listener at localhost/37931] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39503 2023-02-12 03:03:58,575 INFO [Listener at localhost/37931] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:03:58,576 DEBUG [Listener at localhost/37931] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:03:58,576 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,577 INFO [Listener at localhost/37931] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,578 INFO [Listener at localhost/37931] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39503 connecting to ZooKeeper ensemble=127.0.0.1:60941 2023-02-12 03:03:58,587 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:395030x0, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:03:58,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39503-0x10154e9834b0002 connected 2023-02-12 03:03:58,588 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:03:58,589 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:03:58,589 DEBUG [Listener at localhost/37931] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:03:58,590 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-12 03:03:58,590 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39503 2023-02-12 03:03:58,594 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39503 2023-02-12 03:03:58,595 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-12 03:03:58,595 DEBUG [Listener at localhost/37931] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39503 2023-02-12 03:03:58,596 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,597 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:58,598 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,599 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:58,599 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:58,599 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,599 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:03:58,600 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:58,602 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,33459,1676171038488 from backup master directory 2023-02-12 03:03:58,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:03:58,603 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,603 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:03:58,603 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:58,603 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,618 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/hbase.id with ID: a93c6945-414e-41d7-9a5f-e6bf64ce0bf5 2023-02-12 03:03:58,624 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:03:58,627 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,634 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06255270 to 127.0.0.1:60941 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:58,640 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a70c43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:58,641 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:58,641 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:03:58,642 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:58,644 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store-tmp 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:03:58,652 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:58,652 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171038652Disabling compacts and flushes for region at 1676171038652Disabling writes for close at 1676171038652Writing region close event to WAL at 1676171038652Closed at 1676171038652 2023-02-12 03:03:58,652 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/WALs/jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,654 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C33459%2C1676171038488, suffix=, logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/WALs/jenkins-hbase6.apache.org,33459,1676171038488, archiveDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/oldWALs, maxLogs=10 2023-02-12 03:03:58,669 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK] 2023-02-12 03:03:58,669 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK] 2023-02-12 03:03:58,671 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/WALs/jenkins-hbase6.apache.org,33459,1676171038488/jenkins-hbase6.apache.org%2C33459%2C1676171038488.1676171038654 2023-02-12 03:03:58,674 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK]] 2023-02-12 03:03:58,674 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:58,674 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:58,675 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,675 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,676 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,677 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:03:58,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:03:58,677 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:58,678 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,678 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,680 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:03:58,681 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:58,682 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66161040, jitterRate=-0.014123678207397461}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:58,682 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171038675Initializing all the Stores at 1676171038675Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171038675Cleaning up temporary data from old regions at 1676171038679 (+4 ms)Cleaning up detritus from prior splits at 1676171038679Region opened successfully at 1676171038682 (+3 ms) 2023-02-12 03:03:58,682 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:03:58,683 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:03:58,683 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:03:58,683 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:03:58,684 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:03:58,684 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:03:58,684 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:03:58,687 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:03:58,687 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:03:58,697 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:03:58,697 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:03:58,698 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:03:58,698 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:03:58,698 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:03:58,700 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,700 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:03:58,701 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:03:58,701 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:03:58,702 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:58,702 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:58,702 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,702 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:03:58,703 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,33459,1676171038488, sessionid=0x10154e9834b0000, setting cluster-up flag (Was=false) 2023-02-12 03:03:58,711 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,715 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:03:58,716 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,718 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,723 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:03:58,723 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:58,724 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/.tmp 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:58,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,727 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171068727 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,728 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:58,728 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:03:58,728 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:03:58,729 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:03:58,729 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:03:58,729 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:03:58,729 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:03:58,729 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171038729,5,FailOnTimeoutGroup] 2023-02-12 03:03:58,729 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:58,730 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171038729,5,FailOnTimeoutGroup] 2023-02-12 03:03:58,730 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,730 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:03:58,730 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,730 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,741 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:58,741 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:58,741 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd 2023-02-12 03:03:58,748 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:58,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:58,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/info 2023-02-12 03:03:58,750 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:58,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:58,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:58,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:58,752 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:58,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:58,752 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:58,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/table 2023-02-12 03:03:58,753 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:58,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:58,754 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740 2023-02-12 03:03:58,755 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740 2023-02-12 03:03:58,756 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:58,757 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:58,758 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:58,758 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67797158, jitterRate=0.010256379842758179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171038748Initializing all the Stores at 1676171038749 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171038749Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171038749Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171038749Cleaning up temporary data from old regions at 1676171038755 (+6 ms)Cleaning up detritus from prior splits at 1676171038756 (+1 ms)Region opened successfully at 1676171038759 (+3 ms) 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:03:58,759 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:03:58,759 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:03:58,759 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171038759Disabling compacts and flushes for region at 1676171038759Disabling writes for close at 1676171038759Writing region close event to WAL at 1676171038759Closed at 1676171038759 2023-02-12 03:03:58,760 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:03:58,760 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:03:58,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:03:58,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:03:58,767 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:03:58,797 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(952): ClusterId : a93c6945-414e-41d7-9a5f-e6bf64ce0bf5 2023-02-12 03:03:58,797 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(952): ClusterId : a93c6945-414e-41d7-9a5f-e6bf64ce0bf5 2023-02-12 03:03:58,797 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:58,797 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:03:58,799 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:58,799 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:03:58,799 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:58,799 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:03:58,803 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:58,805 DEBUG [RS:0;jenkins-hbase6:33689] zookeeper.ReadOnlyZKClient(139): Connect 0x0eea408c to 127.0.0.1:60941 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:58,805 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:03:58,806 DEBUG [RS:1;jenkins-hbase6:39503] zookeeper.ReadOnlyZKClient(139): Connect 0x29b3c96d to 127.0.0.1:60941 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:58,814 DEBUG [RS:0;jenkins-hbase6:33689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2daf21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:58,814 DEBUG [RS:1;jenkins-hbase6:39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2774222b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:58,814 DEBUG [RS:0;jenkins-hbase6:33689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4122bfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:58,814 DEBUG [RS:1;jenkins-hbase6:39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@234ba21d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:03:58,823 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:39503 2023-02-12 03:03:58,823 INFO [RS:1;jenkins-hbase6:39503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:58,823 INFO [RS:1;jenkins-hbase6:39503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:58,823 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:58,824 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,33459,1676171038488 with isa=jenkins-hbase6.apache.org/172.31.2.20:39503, startcode=1676171038573 2023-02-12 03:03:58,824 DEBUG [RS:1;jenkins-hbase6:39503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:58,826 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:32951, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:58,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,827 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:33689 2023-02-12 03:03:58,828 INFO [RS:0;jenkins-hbase6:33689] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:03:58,828 INFO [RS:0;jenkins-hbase6:33689] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:03:58,828 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:03:58,828 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd 2023-02-12 03:03:58,828 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34773 2023-02-12 03:03:58,828 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:58,828 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,33459,1676171038488 with isa=jenkins-hbase6.apache.org/172.31.2.20:33689, startcode=1676171038538 2023-02-12 03:03:58,828 DEBUG [RS:0;jenkins-hbase6:33689] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:03:58,829 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:58,830 DEBUG [RS:1;jenkins-hbase6:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,830 WARN [RS:1;jenkins-hbase6:39503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:58,830 INFO [RS:1;jenkins-hbase6:39503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:58,830 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,830 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58945, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:03:58,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,832 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd 2023-02-12 03:03:58,832 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34773 2023-02-12 03:03:58,832 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39503,1676171038573] 2023-02-12 03:03:58,832 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:03:58,839 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:03:58,839 DEBUG [RS:0;jenkins-hbase6:33689] zookeeper.ZKUtil(162): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,839 WARN [RS:0;jenkins-hbase6:33689] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:03:58,839 INFO [RS:0;jenkins-hbase6:33689] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:58,839 DEBUG [RS:1;jenkins-hbase6:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,839 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,839 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,33689,1676171038538] 2023-02-12 03:03:58,840 DEBUG [RS:1;jenkins-hbase6:39503] zookeeper.ZKUtil(162): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,840 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:58,841 INFO [RS:1;jenkins-hbase6:39503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:58,847 INFO [RS:1;jenkins-hbase6:39503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:58,847 INFO [RS:1;jenkins-hbase6:39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:58,848 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,848 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:58,849 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,850 DEBUG [RS:0;jenkins-hbase6:33689] zookeeper.ZKUtil(162): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,850 DEBUG [RS:0;jenkins-hbase6:33689] zookeeper.ZKUtil(162): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,850 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:58,851 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,851 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,851 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,851 DEBUG [RS:1;jenkins-hbase6:39503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,851 DEBUG [RS:0;jenkins-hbase6:33689] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:03:58,851 INFO [RS:0;jenkins-hbase6:33689] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:03:58,855 INFO [RS:0;jenkins-hbase6:33689] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:03:58,858 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,858 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,858 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,858 INFO [RS:0;jenkins-hbase6:33689] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:03:58,858 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,859 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:03:58,860 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,860 DEBUG [RS:0;jenkins-hbase6:33689] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:03:58,866 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,867 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,867 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,870 INFO [RS:1;jenkins-hbase6:39503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:58,870 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39503,1676171038573-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,881 INFO [RS:1;jenkins-hbase6:39503] regionserver.Replication(203): jenkins-hbase6.apache.org,39503,1676171038573 started 2023-02-12 03:03:58,881 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39503,1676171038573, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39503, sessionid=0x10154e9834b0002 2023-02-12 03:03:58,881 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:58,881 DEBUG [RS:1;jenkins-hbase6:39503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,881 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39503,1676171038573' 2023-02-12 03:03:58,881 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:58,881 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39503,1676171038573' 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:58,882 DEBUG [RS:1;jenkins-hbase6:39503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:58,882 INFO [RS:1;jenkins-hbase6:39503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:58,882 INFO [RS:1;jenkins-hbase6:39503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:58,884 INFO [RS:0;jenkins-hbase6:33689] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:03:58,884 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33689,1676171038538-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:58,901 INFO [RS:0;jenkins-hbase6:33689] regionserver.Replication(203): jenkins-hbase6.apache.org,33689,1676171038538 started 2023-02-12 03:03:58,901 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,33689,1676171038538, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:33689, sessionid=0x10154e9834b0001 2023-02-12 03:03:58,901 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,33689,1676171038538' 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,33689,1676171038538' 2023-02-12 03:03:58,902 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:03:58,903 DEBUG [RS:0;jenkins-hbase6:33689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:03:58,903 DEBUG [RS:0;jenkins-hbase6:33689] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:03:58,903 INFO [RS:0;jenkins-hbase6:33689] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:03:58,903 INFO [RS:0;jenkins-hbase6:33689] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:03:58,917 DEBUG [jenkins-hbase6:33459] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:03:58,917 DEBUG [jenkins-hbase6:33459] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:58,919 DEBUG [jenkins-hbase6:33459] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:58,919 DEBUG [jenkins-hbase6:33459] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:58,919 DEBUG [jenkins-hbase6:33459] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:58,919 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39503,1676171038573, state=OPENING 2023-02-12 03:03:58,920 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:03:58,921 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:58,922 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:58,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39503,1676171038573}] 2023-02-12 03:03:59,078 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:59,078 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:59,080 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43336, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:59,084 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:03:59,084 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:03:59,085 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39503%2C1676171038573.meta, suffix=.meta, logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,39503,1676171038573, archiveDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs, maxLogs=32 2023-02-12 03:03:59,104 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK] 2023-02-12 03:03:59,104 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK] 2023-02-12 03:03:59,106 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,39503,1676171038573/jenkins-hbase6.apache.org%2C39503%2C1676171038573.meta.1676171039086.meta 2023-02-12 03:03:59,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK]] 2023-02-12 03:03:59,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:03:59,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:03:59,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:03:59,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:03:59,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/info 2023-02-12 03:03:59,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/info 2023-02-12 03:03:59,110 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:03:59,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,110 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:03:59,111 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:59,111 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:03:59,111 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:03:59,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:03:59,112 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/table 2023-02-12 03:03:59,112 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/table 2023-02-12 03:03:59,113 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:03:59,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740 2023-02-12 03:03:59,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740 2023-02-12 03:03:59,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:03:59,117 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:03:59,117 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71380588, jitterRate=0.06365364789962769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:03:59,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171039107Writing region info on filesystem at 1676171039107Initializing all the Stores at 1676171039108 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171039108Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171039108Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171039108Cleaning up temporary data from old regions at 1676171039115 (+7 ms)Cleaning up detritus from prior splits at 1676171039115Running coprocessor post-open hooks at 1676171039118 (+3 ms)Region opened successfully at 1676171039118 2023-02-12 03:03:59,118 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171039078 2023-02-12 03:03:59,122 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:03:59,122 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:03:59,123 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,39503,1676171038573, state=OPEN 2023-02-12 03:03:59,124 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:03:59,124 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:03:59,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:03:59,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,39503,1676171038573 in 202 msec 2023-02-12 03:03:59,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:03:59,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-12 03:03:59,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-12 03:03:59,128 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171038598, completionTime=-1 2023-02-12 03:03:59,128 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:03:59,128 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:03:59,130 DEBUG [hconnection-0x157d80d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:59,132 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:59,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:03:59,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171099133 2023-02-12 03:03:59,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171159133 2023-02-12 03:03:59,133 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33459,1676171038488-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33459,1676171038488-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33459,1676171038488-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:33459, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:03:59,141 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:59,142 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:03:59,143 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:59,143 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:03:59,144 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:59,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,145 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4 empty. 2023-02-12 03:03:59,146 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:03:59,153 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:59,154 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2a432a3e398fc253265fff99f18832c4, NAME => 'hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 2a432a3e398fc253265fff99f18832c4, disabling compactions & flushes 2023-02-12 03:03:59,160 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. after waiting 0 ms 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,160 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 2a432a3e398fc253265fff99f18832c4: Waiting for close lock at 1676171039160Disabling compacts and flushes for region at 1676171039160Disabling writes for close at 1676171039160Writing region close event to WAL at 1676171039160Closed at 1676171039160 2023-02-12 03:03:59,162 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:59,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171039163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171039163"}]},"ts":"1676171039163"} 2023-02-12 03:03:59,165 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:59,166 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:59,166 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171039166"}]},"ts":"1676171039166"} 2023-02-12 03:03:59,167 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:03:59,170 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:59,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2a432a3e398fc253265fff99f18832c4, ASSIGN}] 2023-02-12 03:03:59,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2a432a3e398fc253265fff99f18832c4, ASSIGN 2023-02-12 03:03:59,174 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2a432a3e398fc253265fff99f18832c4, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,39503,1676171038573; forceNewPlan=false, retain=false 2023-02-12 03:03:59,324 INFO [jenkins-hbase6:33459] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:59,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2a432a3e398fc253265fff99f18832c4, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:59,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171039325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171039325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171039325"}]},"ts":"1676171039325"} 2023-02-12 03:03:59,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2a432a3e398fc253265fff99f18832c4, server=jenkins-hbase6.apache.org,39503,1676171038573}] 2023-02-12 03:03:59,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,482 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39503%2C1676171038573, suffix=, logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,39503,1676171038573, archiveDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs, maxLogs=32 2023-02-12 03:03:59,494 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK] 2023-02-12 03:03:59,494 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK] 2023-02-12 03:03:59,496 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,39503,1676171038573/jenkins-hbase6.apache.org%2C39503%2C1676171038573.1676171039483 2023-02-12 03:03:59,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK], DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK]] 2023-02-12 03:03:59,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2a432a3e398fc253265fff99f18832c4, NAME => 'hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:59,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:59,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,498 INFO [StoreOpener-2a432a3e398fc253265fff99f18832c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,499 DEBUG [StoreOpener-2a432a3e398fc253265fff99f18832c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/info 2023-02-12 03:03:59,499 DEBUG [StoreOpener-2a432a3e398fc253265fff99f18832c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/info 2023-02-12 03:03:59,499 INFO [StoreOpener-2a432a3e398fc253265fff99f18832c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a432a3e398fc253265fff99f18832c4 columnFamilyName info 2023-02-12 03:03:59,499 INFO [StoreOpener-2a432a3e398fc253265fff99f18832c4-1] regionserver.HStore(310): Store=2a432a3e398fc253265fff99f18832c4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:03:59,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:59,504 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 2a432a3e398fc253265fff99f18832c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66312509, jitterRate=-0.01186661422252655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:03:59,504 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 2a432a3e398fc253265fff99f18832c4: Running coprocessor pre-open hook at 1676171039497Writing region info on filesystem at 1676171039497Initializing all the Stores at 1676171039497Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171039497Cleaning up temporary data from old regions at 1676171039500 (+3 ms)Cleaning up detritus from prior splits at 1676171039501 (+1 ms)Running coprocessor post-open hooks at 1676171039504 (+3 ms)Region opened successfully at 1676171039504 2023-02-12 03:03:59,504 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4., pid=6, masterSystemTime=1676171039478 2023-02-12 03:03:59,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,507 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:03:59,507 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2a432a3e398fc253265fff99f18832c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:03:59,507 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171039507"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171039507"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171039507"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171039507"}]},"ts":"1676171039507"} 2023-02-12 03:03:59,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:03:59,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2a432a3e398fc253265fff99f18832c4, server=jenkins-hbase6.apache.org,39503,1676171038573 in 181 msec 2023-02-12 03:03:59,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:03:59,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2a432a3e398fc253265fff99f18832c4, ASSIGN in 339 msec 2023-02-12 03:03:59,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:59,512 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171039511"}]},"ts":"1676171039511"} 2023-02-12 03:03:59,513 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:03:59,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:59,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 374 msec 2023-02-12 03:03:59,543 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:03:59,544 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:59,544 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:03:59,548 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:03:59,554 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:59,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 03:03:59,559 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:03:59,565 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:03:59,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-12 03:03:59,584 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:03:59,587 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.984sec 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33459,1676171038488-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:03:59,587 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,33459,1676171038488-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:03:59,588 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:03:59,597 DEBUG [Listener at localhost/37931] zookeeper.ReadOnlyZKClient(139): Connect 0x026de49f to 127.0.0.1:60941 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:03:59,604 DEBUG [Listener at localhost/37931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9cce62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:03:59,606 DEBUG [hconnection-0x751cc43a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:03:59,607 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43358, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:03:59,609 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:03:59,609 DEBUG [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:03:59,610 DEBUG [Listener at localhost/37931] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:03:59,612 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41390, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:03:59,612 INFO [Listener at localhost/37931] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 03:03:59,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceSingleRegion 2023-02-12 03:03:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:03:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.2.20:41390 deadline: 1676171099613, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-12 03:03:59,613 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-12 03:03:59,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:03:59,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:03:59,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:03:59,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-12 03:03:59,618 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:03:59,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:59,619 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 empty. 2023-02-12 03:03:59,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,620 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 03:03:59,628 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 03:03:59,629 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => ed3e726872807695d27c67fdffab98e6, NAME => 'testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp 2023-02-12 03:03:59,634 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:59,634 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing ed3e726872807695d27c67fdffab98e6, disabling compactions & flushes 2023-02-12 03:03:59,634 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,634 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,634 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. after waiting 0 ms 2023-02-12 03:03:59,634 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,634 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,635 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for ed3e726872807695d27c67fdffab98e6: Waiting for close lock at 1676171039634Disabling compacts and flushes for region at 1676171039634Disabling writes for close at 1676171039634Writing region close event to WAL at 1676171039634Closed at 1676171039634 2023-02-12 03:03:59,636 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:03:59,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676171039637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171039637"}]},"ts":"1676171039637"} 2023-02-12 03:03:59,638 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:03:59,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:03:59,639 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171039639"}]},"ts":"1676171039639"} 2023-02-12 03:03:59,640 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-12 03:03:59,644 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:03:59,645 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:03:59,645 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:03:59,645 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:03:59,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, ASSIGN}] 2023-02-12 03:03:59,647 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, ASSIGN 2023-02-12 03:03:59,648 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,33689,1676171038538; forceNewPlan=false, retain=false 2023-02-12 03:03:59,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:59,798 INFO [jenkins-hbase6:33459] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:03:59,798 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ed3e726872807695d27c67fdffab98e6, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:59,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676171039798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171039798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171039798"}]},"ts":"1676171039798"} 2023-02-12 03:03:59,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ed3e726872807695d27c67fdffab98e6, server=jenkins-hbase6.apache.org,33689,1676171038538}] 2023-02-12 03:03:59,876 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:03:59,876 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 03:03:59,905 INFO [RS:0;jenkins-hbase6:33689] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C33689%2C1676171038538, suffix=, logDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,33689,1676171038538, archiveDir=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs, maxLogs=32 2023-02-12 03:03:59,925 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK] 2023-02-12 03:03:59,925 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK] 2023-02-12 03:03:59,926 INFO [RS:0;jenkins-hbase6:33689] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/WALs/jenkins-hbase6.apache.org,33689,1676171038538/jenkins-hbase6.apache.org%2C33689%2C1676171038538.1676171039905 2023-02-12 03:03:59,927 DEBUG [RS:0;jenkins-hbase6:33689] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-42545018-a3d8-4575-8735-45fb27a23581,DISK], DatanodeInfoWithStorage[127.0.0.1:34423,DS-27a0aba0-a57e-4081-a57f-aa177fad25d8,DISK]] 2023-02-12 03:03:59,953 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:59,953 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:03:59,954 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:55700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:03:59,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed3e726872807695d27c67fdffab98e6, NAME => 'testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:03:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:03:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,958 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,959 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1 2023-02-12 03:03:59,959 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1 2023-02-12 03:03:59,959 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3e726872807695d27c67fdffab98e6 columnFamilyName f1 2023-02-12 03:03:59,960 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(310): Store=ed3e726872807695d27c67fdffab98e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,960 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,961 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2 2023-02-12 03:03:59,961 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2 2023-02-12 03:03:59,961 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3e726872807695d27c67fdffab98e6 columnFamilyName f2 2023-02-12 03:03:59,962 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(310): Store=ed3e726872807695d27c67fdffab98e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:03:59,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:03:59,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for ed3e726872807695d27c67fdffab98e6 2023-02-12 03:03:59,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:03:59,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened ed3e726872807695d27c67fdffab98e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71937005, jitterRate=0.07194490730762482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:03:59,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for ed3e726872807695d27c67fdffab98e6: Running coprocessor pre-open hook at 1676171039957Writing region info on filesystem at 1676171039957Initializing all the Stores at 1676171039958 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171039958Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171039958Cleaning up temporary data from old regions at 1676171039963 (+5 ms)Cleaning up detritus from prior splits at 1676171039963Running coprocessor post-open hooks at 1676171039966 (+3 ms)Region opened successfully at 1676171039966 2023-02-12 03:03:59,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6., pid=12, masterSystemTime=1676171039952 2023-02-12 03:03:59,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:03:59,973 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ed3e726872807695d27c67fdffab98e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:03:59,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676171039973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171039973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171039973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171039973"}]},"ts":"1676171039973"} 2023-02-12 03:03:59,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:03:59,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 03:03:59,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ed3e726872807695d27c67fdffab98e6, server=jenkins-hbase6.apache.org,33689,1676171038538 in 174 msec 2023-02-12 03:03:59,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 03:03:59,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, ASSIGN in 332 msec 2023-02-12 03:03:59,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:03:59,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171039979"}]},"ts":"1676171039979"} 2023-02-12 03:03:59,980 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-12 03:03:59,982 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:03:59,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 367 msec 2023-02-12 03:04:00,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:00,277 INFO [Listener at localhost/37931] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-12 03:04:00,277 DEBUG [Listener at localhost/37931] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-12 03:04:00,277 INFO [Listener at localhost/37931] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:00,279 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-12 03:04:00,279 INFO [Listener at localhost/37931] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:00,280 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-12 03:04:00,280 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:04:00,292 DEBUG [hconnection-0x751cc43a-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:00,307 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:55704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:00,315 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33689] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,402 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:04:00,402 INFO [Listener at localhost/37931] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:04:00,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 03:04:00,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171040403 (current time:1676171040403). 2023-02-12 03:04:00,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:04:00,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] zookeeper.ReadOnlyZKClient(139): Connect 0x1559ada6 to 127.0.0.1:60941 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:00,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e7be5a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:00,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:00,408 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:43374, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:00,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1559ada6 to 127.0.0.1:60941 2023-02-12 03:04:00,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:00,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:04:00,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 03:04:00,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 03:04:00,413 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 03:04:00,413 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676171640413 2023-02-12 03:04:00,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 03:04:00,413 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,414 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:00,415 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:04:00,415 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 03:04:00,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 03:04:00,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-12 03:04:00,417 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 03:04:00,417 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676171640417 2023-02-12 03:04:00,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,424 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 03:04:00,424 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:00,425 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 03:04:00,425 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 03:04:00,425 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,425 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,428 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:00,428 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:00,428 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:00,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:00,428 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,428 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 03:04:00,430 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,33689,1676171038538' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 03:04:00,431 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:00,431 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 03:04:00,431 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39503,1676171038573' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 03:04:00,432 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,433 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,33689,1676171038538' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 03:04:00,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72750e24[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:00,435 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 03:04:00,435 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:00,436 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:00,436 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 03:04:00,436 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. started... 2023-02-12 03:04:00,436 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,39503,1676171038573' in zk 2023-02-12 03:04:00,436 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ed3e726872807695d27c67fdffab98e6 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 03:04:00,438 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:00,438 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,438 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 03:04:00,450 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f1/ce79342c34b54776ba5cda95682bce8b 2023-02-12 03:04:00,466 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 2023-02-12 03:04:00,470 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f1/ce79342c34b54776ba5cda95682bce8b as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b 2023-02-12 03:04:00,473 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:00,474 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 2023-02-12 03:04:00,478 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:00,478 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ed3e726872807695d27c67fdffab98e6 in 42ms, sequenceid=5, compaction requested=false 2023-02-12 03:04:00,478 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ed3e726872807695d27c67fdffab98e6: 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b] hfiles 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28] hfiles 2023-02-12 03:04:00,479 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,484 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. completed. 2023-02-12 03:04:00,484 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,484 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 03:04:00,484 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 03:04:00,484 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,484 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 03:04:00,484 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,33689,1676171038538' in zk 2023-02-12 03:04:00,487 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,487 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:00,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,487 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:00,487 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 03:04:00,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,33689,1676171038538': 2023-02-12 03:04:00,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,33689,1676171038538' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 03:04:00,489 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 03:04:00,489 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:00,490 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:00,490 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,490 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:04:00,491 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:00,491 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:00,491 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:00,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:00,492 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,492 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,494 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,494 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:00,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:00,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:00,499 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:00,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:00,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:00,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,515 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:00,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 03:04:00,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:04:00,517 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:04:00,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-12 03:04:00,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,528 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676171040414Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676171040499 (+85 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676171040499Writing data manifest for testWithMockedMapReduceSingleRegion at 1676171040502 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676171040508 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676171040527 (+19 ms) 2023-02-12 03:04:00,530 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 03:04:00,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 116 msec 2023-02-12 03:04:00,717 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:00,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 03:04:00,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:04:00,719 INFO [Listener at localhost/37931] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:04:00,722 INFO [Listener at localhost/37931] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:04:00,727 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:04:00,758 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33689] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,839 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:04:00,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:04:00,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,846 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 03:04:00,846 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:00,847 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 03:04:00,847 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 03:04:00,847 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,847 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,849 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:00,849 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,849 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:00,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:00,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:00,850 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,850 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,851 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 03:04:00,851 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:00,851 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 03:04:00,852 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:00,852 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:00,853 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:00,853 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 03:04:00,853 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39503,1676171038573' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 03:04:00,853 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:04:00,853 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:04:00,853 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,853 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. started... 2023-02-12 03:04:00,853 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ed3e726872807695d27c67fdffab98e6 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 03:04:00,855 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,855 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,855 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:00,868 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f1/893be27a2d394fb1a4d13da821b48267 2023-02-12 03:04:00,885 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f2/cb3670c76c5c46d3a693b7cfa0f671f4 2023-02-12 03:04:00,889 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f1/893be27a2d394fb1a4d13da821b48267 as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/893be27a2d394fb1a4d13da821b48267 2023-02-12 03:04:00,893 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/893be27a2d394fb1a4d13da821b48267, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:00,894 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/.tmp/f2/cb3670c76c5c46d3a693b7cfa0f671f4 as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/cb3670c76c5c46d3a693b7cfa0f671f4 2023-02-12 03:04:00,898 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/cb3670c76c5c46d3a693b7cfa0f671f4, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:00,899 INFO [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ed3e726872807695d27c67fdffab98e6 in 46ms, sequenceid=9, compaction requested=false 2023-02-12 03:04:00,900 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ed3e726872807695d27c67fdffab98e6: 2023-02-12 03:04:00,900 DEBUG [rs(jenkins-hbase6.apache.org,33689,1676171038538)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:00,900 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:04:00,900 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:04:00,900 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,900 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 03:04:00,900 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,33689,1676171038538' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 03:04:00,902 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,902 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:00,902 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,902 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,33689,1676171038538' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 03:04:00,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@764a84b2[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:00,904 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 03:04:00,904 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,39503,1676171038573' in zk 2023-02-12 03:04:00,905 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,906 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:00,905 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,33689,1676171038538' in zk 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:00,908 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,33689,1676171038538' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 03:04:00,908 DEBUG [member: 'jenkins-hbase6.apache.org,39503,1676171038573' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 03:04:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,33689,1676171038538': 2023-02-12 03:04:00,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,33689,1676171038538' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 03:04:00,911 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 03:04:00,911 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:00,911 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:00,911 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,911 INFO [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:04:00,913 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:00,913 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:00,913 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:00,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:00,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,913 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,915 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:00,915 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-12 03:04:00,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:00,918 DEBUG [(jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:00,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:00,918 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:00,919 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:04:00,919 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:00,919 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:01,019 DEBUG [Listener at localhost/37931] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:04:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:04:01,024 INFO [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676171040403 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:01,024 DEBUG [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979/data/default/testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,025 INFO [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(239): region to add: ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,025 INFO [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(585): clone region=ed3e726872807695d27c67fdffab98e6 as ed3e726872807695d27c67fdffab98e6 in snapshot testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,025 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ed3e726872807695d27c67fdffab98e6, NAME => 'testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979 2023-02-12 03:04:01,031 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:01,031 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ce79342c34b54776ba5cda95682bce8b from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,033 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f3e3e0908fbf4ae08a9dc3e81f0cea28 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ed3e726872807695d27c67fdffab98e6, disabling compactions & flushes 2023-02-12 03:04:01,035 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. after waiting 0 ms 2023-02-12 03:04:01,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,035 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,035 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ed3e726872807695d27c67fdffab98e6: Waiting for close lock at 1676171041035Disabling compacts and flushes for region at 1676171041035Disabling writes for close at 1676171041035Writing region close event to WAL at 1676171041035Closed at 1676171041035 2023-02-12 03:04:01,035 INFO [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676171040403 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:01,035 DEBUG [Listener at localhost/37931] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979 2023-02-12 03:04:01,035 DEBUG [Listener at localhost/37931] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979 2023-02-12 03:04:01,036 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |-data/ 2023-02-12 03:04:01,036 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |----default/ 2023-02-12 03:04:01,036 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-12 03:04:01,037 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |----------ed3e726872807695d27c67fdffab98e6/ 2023-02-12 03:04:01,037 DEBUG [Listener at localhost/37931] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:04:01,037 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:04:01,037 DEBUG [Listener at localhost/37931] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=ed3e726872807695d27c67fdffab98e6-ce79342c34b54776ba5cda95682bce8b 2023-02-12 03:04:01,037 DEBUG [Listener at localhost/37931] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:04:01,038 DEBUG [Listener at localhost/37931] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=ed3e726872807695d27c67fdffab98e6-f3e3e0908fbf4ae08a9dc3e81f0cea28 2023-02-12 03:04:01,040 INFO [Listener at localhost/37931] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 03:04:01,043 DEBUG [Listener at localhost/37931] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:01,043 INFO [Listener at localhost/37931] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:04:01,043 DEBUG [Listener at localhost/37931] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:01,045 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,046 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1 2023-02-12 03:04:01,046 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3e726872807695d27c67fdffab98e6 columnFamilyName f1 2023-02-12 03:04:01,049 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(539): loaded hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/testWithMockedMapReduceSingleRegion=ed3e726872807695d27c67fdffab98e6-ce79342c34b54776ba5cda95682bce8b 2023-02-12 03:04:01,049 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(310): Store=ed3e726872807695d27c67fdffab98e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:01,050 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,050 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2 2023-02-12 03:04:01,050 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed3e726872807695d27c67fdffab98e6 columnFamilyName f2 2023-02-12 03:04:01,053 DEBUG [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(539): loaded hdfs://localhost:34773/user/jenkins/test-data/67275d9d-12fc-b6ec-580a-a58d0fdc7d69/testWithMockedMapReduceSingleRegion/cefd67c7-cf47-4310-af96-e0b85e0f6979/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/testWithMockedMapReduceSingleRegion=ed3e726872807695d27c67fdffab98e6-f3e3e0908fbf4ae08a9dc3e81f0cea28 2023-02-12 03:04:01,054 INFO [StoreOpener-ed3e726872807695d27c67fdffab98e6-1] regionserver.HStore(310): Store=ed3e726872807695d27c67fdffab98e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:01,054 DEBUG [Listener at localhost/37931] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:04:01,054 INFO [Listener at localhost/37931] regionserver.HRegion(1071): Opened ed3e726872807695d27c67fdffab98e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60172000, jitterRate=-0.10336732864379883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:04:01,054 DEBUG [Listener at localhost/37931] regionserver.HRegion(964): Region open journal for ed3e726872807695d27c67fdffab98e6: Writing region info on filesystem at 1676171041044Initializing all the Stores at 1676171041044Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171041044Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171041044Region opened successfully at 1676171041054 (+10 ms) 2023-02-12 03:04:01,100 DEBUG [Listener at localhost/37931] regionserver.HRegion(1603): Closing ed3e726872807695d27c67fdffab98e6, disabling compactions & flushes 2023-02-12 03:04:01,100 INFO [Listener at localhost/37931] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,100 DEBUG [Listener at localhost/37931] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,100 DEBUG [Listener at localhost/37931] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. after waiting 0 ms 2023-02-12 03:04:01,100 DEBUG [Listener at localhost/37931] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,101 INFO [Listener at localhost/37931] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,101 DEBUG [Listener at localhost/37931] regionserver.HRegion(1557): Region close journal for ed3e726872807695d27c67fdffab98e6: Waiting for close lock at 1676171041100Disabling compacts and flushes for region at 1676171041100Disabling writes for close at 1676171041100Writing region close event to WAL at 1676171041101 (+1 ms)Closed at 1676171041101 2023-02-12 03:04:01,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-12 03:04:01,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,109 INFO [Listener at localhost/37931] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171041113"}]},"ts":"1676171041113"} 2023-02-12 03:04:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:01,114 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-12 03:04:01,116 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-12 03:04:01,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, UNASSIGN}] 2023-02-12 03:04:01,118 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, UNASSIGN 2023-02-12 03:04:01,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ed3e726872807695d27c67fdffab98e6, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:01,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676171041119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171041119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171041119"}]},"ts":"1676171041119"} 2023-02-12 03:04:01,120 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ed3e726872807695d27c67fdffab98e6, server=jenkins-hbase6.apache.org,33689,1676171038538}] 2023-02-12 03:04:01,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:01,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing ed3e726872807695d27c67fdffab98e6, disabling compactions & flushes 2023-02-12 03:04:01,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. after waiting 0 ms 2023-02-12 03:04:01,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:04:01,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6. 2023-02-12 03:04:01,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for ed3e726872807695d27c67fdffab98e6: Waiting for close lock at 1676171041272Running coprocessor pre-close hooks at 1676171041272Disabling compacts and flushes for region at 1676171041272Disabling writes for close at 1676171041272Writing region close event to WAL at 1676171041273 (+1 ms)Running coprocessor post-close hooks at 1676171041276 (+3 ms)Closed at 1676171041276 2023-02-12 03:04:01,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,278 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ed3e726872807695d27c67fdffab98e6, regionState=CLOSED 2023-02-12 03:04:01,279 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676171041278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171041278"}]},"ts":"1676171041278"} 2023-02-12 03:04:01,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 03:04:01,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ed3e726872807695d27c67fdffab98e6, server=jenkins-hbase6.apache.org,33689,1676171038538 in 160 msec 2023-02-12 03:04:01,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 03:04:01,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=ed3e726872807695d27c67fdffab98e6, UNASSIGN in 164 msec 2023-02-12 03:04:01,283 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171041283"}]},"ts":"1676171041283"} 2023-02-12 03:04:01,284 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-12 03:04:01,287 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-12 03:04:01,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-12 03:04:01,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:01,417 INFO [Listener at localhost/37931] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-12 03:04:01,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,421 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:01,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,425 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1, FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2, FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/recovered.edits] 2023-02-12 03:04:01,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/893be27a2d394fb1a4d13da821b48267 to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/archive/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/893be27a2d394fb1a4d13da821b48267 2023-02-12 03:04:01,429 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/archive/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f1/ce79342c34b54776ba5cda95682bce8b 2023-02-12 03:04:01,431 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/cb3670c76c5c46d3a693b7cfa0f671f4 to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/archive/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/cb3670c76c5c46d3a693b7cfa0f671f4 2023-02-12 03:04:01,432 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/archive/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/f2/f3e3e0908fbf4ae08a9dc3e81f0cea28 2023-02-12 03:04:01,435 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/recovered.edits/12.seqid to hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/archive/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6/recovered.edits/12.seqid 2023-02-12 03:04:01,435 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/.tmp/data/default/testWithMockedMapReduceSingleRegion/ed3e726872807695d27c67fdffab98e6 2023-02-12 03:04:01,435 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 03:04:01,437 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,438 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-12 03:04:01,440 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-12 03:04:01,441 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,441 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-12 03:04:01,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171041441"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:01,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 03:04:01,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ed3e726872807695d27c67fdffab98e6, NAME => 'testWithMockedMapReduceSingleRegion,,1676171039615.ed3e726872807695d27c67fdffab98e6.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 03:04:01,442 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-12 03:04:01,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171041442"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:01,443 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-12 03:04:01,445 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 03:04:01,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 27 msec 2023-02-12 03:04:01,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33459] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:01,523 INFO [Listener at localhost/37931] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-12 03:04:01,523 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:04:01,523 INFO [Listener at localhost/37931] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:04:01,523 DEBUG [Listener at localhost/37931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x026de49f to 127.0.0.1:60941 2023-02-12 03:04:01,523 DEBUG [Listener at localhost/37931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,523 DEBUG [Listener at localhost/37931] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:04:01,523 DEBUG [Listener at localhost/37931] util.JVMClusterUtil(257): Found active master hash=654343917, stopped=false 2023-02-12 03:04:01,523 INFO [Listener at localhost/37931] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:04:01,525 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:01,525 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:01,525 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:01,525 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:01,525 INFO [Listener at localhost/37931] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:04:01,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:01,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:01,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:01,527 DEBUG [Listener at localhost/37931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06255270 to 127.0.0.1:60941 2023-02-12 03:04:01,527 DEBUG [Listener at localhost/37931] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,527 INFO [Listener at localhost/37931] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,33689,1676171038538' ***** 2023-02-12 03:04:01,527 INFO [Listener at localhost/37931] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:01,527 INFO [Listener at localhost/37931] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39503,1676171038573' ***** 2023-02-12 03:04:01,527 INFO [Listener at localhost/37931] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:01,527 INFO [RS:0;jenkins-hbase6:33689] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:01,528 INFO [RS:0;jenkins-hbase6:33689] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:01,528 INFO [RS:1;jenkins-hbase6:39503] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:01,528 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:01,528 INFO [RS:0;jenkins-hbase6:33689] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:01,528 INFO [RS:1;jenkins-hbase6:39503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:01,528 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:01,529 INFO [RS:1;jenkins-hbase6:39503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:01,529 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:01,529 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(3304): Received CLOSE for 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:04:01,529 DEBUG [RS:0;jenkins-hbase6:33689] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0eea408c to 127.0.0.1:60941 2023-02-12 03:04:01,529 DEBUG [RS:0;jenkins-hbase6:33689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,530 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,33689,1676171038538; all regions closed. 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:01,530 DEBUG [RS:1;jenkins-hbase6:39503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29b3c96d to 127.0.0.1:60941 2023-02-12 03:04:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 2a432a3e398fc253265fff99f18832c4, disabling compactions & flushes 2023-02-12 03:04:01,530 DEBUG [RS:1;jenkins-hbase6:39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. after waiting 0 ms 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:01,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:04:01,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 2a432a3e398fc253265fff99f18832c4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:04:01,530 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 03:04:01,530 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1479): Online Regions={2a432a3e398fc253265fff99f18832c4=hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 03:04:01,530 DEBUG [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1505): Waiting on 1588230740, 2a432a3e398fc253265fff99f18832c4 2023-02-12 03:04:01,530 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:04:01,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:04:01,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:04:01,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:04:01,531 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:04:01,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-12 03:04:01,534 DEBUG [RS:0;jenkins-hbase6:33689] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C33689%2C1676171038538:(num 1676171039905) 2023-02-12 03:04:01,534 DEBUG [RS:0;jenkins-hbase6:33689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:01,534 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:01,534 INFO [RS:0;jenkins-hbase6:33689] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:01,535 INFO [RS:0;jenkins-hbase6:33689] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:33689 2023-02-12 03:04:01,537 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:01,538 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:01,538 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,33689,1676171038538 2023-02-12 03:04:01,538 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3142d154 rejected from java.util.concurrent.ThreadPoolExecutor@357d53a4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:01,538 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:01,538 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66aa0e2c rejected from java.util.concurrent.ThreadPoolExecutor@357d53a4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:01,538 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:01,538 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,33689,1676171038538] 2023-02-12 03:04:01,538 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,33689,1676171038538; numProcessing=1 2023-02-12 03:04:01,541 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,33689,1676171038538 already deleted, retry=false 2023-02-12 03:04:01,541 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,33689,1676171038538 expired; onlineServers=1 2023-02-12 03:04:01,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/.tmp/info/265d97d9454e409189114471872ed3ff 2023-02-12 03:04:01,543 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/info/46b9bfe2fa0e4abe8b4f8cc7debc9a61 2023-02-12 03:04:01,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b9bfe2fa0e4abe8b4f8cc7debc9a61 2023-02-12 03:04:01,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/.tmp/info/265d97d9454e409189114471872ed3ff as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/info/265d97d9454e409189114471872ed3ff 2023-02-12 03:04:01,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/info/265d97d9454e409189114471872ed3ff, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:04:01,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2a432a3e398fc253265fff99f18832c4 in 22ms, sequenceid=6, compaction requested=false 2023-02-12 03:04:01,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/rep_barrier/54d07b46670e44bea4fd318aecc457ea 2023-02-12 03:04:01,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/namespace/2a432a3e398fc253265fff99f18832c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:04:01,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:04:01,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 2a432a3e398fc253265fff99f18832c4: Waiting for close lock at 1676171041530Running coprocessor pre-close hooks at 1676171041530Disabling compacts and flushes for region at 1676171041530Disabling writes for close at 1676171041530Obtaining lock to block concurrent updates at 1676171041530Preparing flush snapshotting stores in 2a432a3e398fc253265fff99f18832c4 at 1676171041530Finished memstore snapshotting hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171041530Flushing stores of hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. at 1676171041531 (+1 ms)Flushing 2a432a3e398fc253265fff99f18832c4/info: creating writer at 1676171041531Flushing 2a432a3e398fc253265fff99f18832c4/info: appending metadata at 1676171041534 (+3 ms)Flushing 2a432a3e398fc253265fff99f18832c4/info: closing flushed file at 1676171041534Flushing 2a432a3e398fc253265fff99f18832c4/info: reopening flushed file at 1676171041548 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2a432a3e398fc253265fff99f18832c4 in 22ms, sequenceid=6, compaction requested=false at 1676171041552 (+4 ms)Writing region close event to WAL at 1676171041557 (+5 ms)Running coprocessor post-close hooks at 1676171041560 (+3 ms)Closed at 1676171041560 2023-02-12 03:04:01,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171039141.2a432a3e398fc253265fff99f18832c4. 2023-02-12 03:04:01,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54d07b46670e44bea4fd318aecc457ea 2023-02-12 03:04:01,569 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/table/3f071ba0e82c47e69353c5b634838f22 2023-02-12 03:04:01,573 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f071ba0e82c47e69353c5b634838f22 2023-02-12 03:04:01,573 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/info/46b9bfe2fa0e4abe8b4f8cc7debc9a61 as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/info/46b9bfe2fa0e4abe8b4f8cc7debc9a61 2023-02-12 03:04:01,574 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:01,574 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:01,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b9bfe2fa0e4abe8b4f8cc7debc9a61 2023-02-12 03:04:01,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/info/46b9bfe2fa0e4abe8b4f8cc7debc9a61, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 03:04:01,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/rep_barrier/54d07b46670e44bea4fd318aecc457ea as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/rep_barrier/54d07b46670e44bea4fd318aecc457ea 2023-02-12 03:04:01,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54d07b46670e44bea4fd318aecc457ea 2023-02-12 03:04:01,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/rep_barrier/54d07b46670e44bea4fd318aecc457ea, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:04:01,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/.tmp/table/3f071ba0e82c47e69353c5b634838f22 as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/table/3f071ba0e82c47e69353c5b634838f22 2023-02-12 03:04:01,589 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f071ba0e82c47e69353c5b634838f22 2023-02-12 03:04:01,589 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/table/3f071ba0e82c47e69353c5b634838f22, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 03:04:01,592 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false 2023-02-12 03:04:01,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 03:04:01,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:04:01,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:01,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171041530Running coprocessor pre-close hooks at 1676171041530Disabling compacts and flushes for region at 1676171041530Disabling writes for close at 1676171041531 (+1 ms)Obtaining lock to block concurrent updates at 1676171041531Preparing flush snapshotting stores in 1588230740 at 1676171041531Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676171041531Flushing stores of hbase:meta,,1.1588230740 at 1676171041532 (+1 ms)Flushing 1588230740/info: creating writer at 1676171041532Flushing 1588230740/info: appending metadata at 1676171041537 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676171041537Flushing 1588230740/rep_barrier: creating writer at 1676171041548 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171041549 (+1 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171041549Flushing 1588230740/table: creating writer at 1676171041563 (+14 ms)Flushing 1588230740/table: appending metadata at 1676171041564 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676171041564Flushing 1588230740/info: reopening flushed file at 1676171041574 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171041581 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676171041585 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false at 1676171041593 (+8 ms)Writing region close event to WAL at 1676171041595 (+2 ms)Running coprocessor post-close hooks at 1676171041598 (+3 ms)Closed at 1676171041598 2023-02-12 03:04:01,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:01,726 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:01,726 INFO [RS:0;jenkins-hbase6:33689] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,33689,1676171038538; zookeeper connection closed. 2023-02-12 03:04:01,726 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e7a2023 rejected from java.util.concurrent.ThreadPoolExecutor@357d53a4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:01,726 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:33689-0x10154e9834b0001, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:01,726 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@263d8368 rejected from java.util.concurrent.ThreadPoolExecutor@357d53a4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:01,726 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ae7e577] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ae7e577 2023-02-12 03:04:01,731 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39503,1676171038573; all regions closed. 2023-02-12 03:04:01,734 DEBUG [RS:1;jenkins-hbase6:39503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs 2023-02-12 03:04:01,734 INFO [RS:1;jenkins-hbase6:39503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39503%2C1676171038573.meta:.meta(num 1676171039086) 2023-02-12 03:04:01,737 DEBUG [RS:1;jenkins-hbase6:39503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/oldWALs 2023-02-12 03:04:01,738 INFO [RS:1;jenkins-hbase6:39503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39503%2C1676171038573:(num 1676171039483) 2023-02-12 03:04:01,738 DEBUG [RS:1;jenkins-hbase6:39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,738 INFO [RS:1;jenkins-hbase6:39503] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:01,738 INFO [RS:1;jenkins-hbase6:39503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:01,738 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:01,739 INFO [RS:1;jenkins-hbase6:39503] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39503 2023-02-12 03:04:01,740 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39503,1676171038573 2023-02-12 03:04:01,740 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:01,740 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4852a7ea rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:01,741 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39503,1676171038573] 2023-02-12 03:04:01,742 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39503,1676171038573; numProcessing=2 2023-02-12 03:04:01,743 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39503,1676171038573 already deleted, retry=false 2023-02-12 03:04:01,743 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39503,1676171038573 expired; onlineServers=0 2023-02-12 03:04:01,743 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,33459,1676171038488' ***** 2023-02-12 03:04:01,743 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:04:01,744 DEBUG [M:0;jenkins-hbase6:33459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@233feed5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:01,744 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,33459,1676171038488 2023-02-12 03:04:01,744 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,33459,1676171038488; all regions closed. 2023-02-12 03:04:01,745 DEBUG [M:0;jenkins-hbase6:33459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:01,745 DEBUG [M:0;jenkins-hbase6:33459] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:04:01,745 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:04:01,745 DEBUG [M:0;jenkins-hbase6:33459] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:04:01,745 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171038729] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171038729,5,FailOnTimeoutGroup] 2023-02-12 03:04:01,745 INFO [M:0;jenkins-hbase6:33459] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:04:01,745 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171038729] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171038729,5,FailOnTimeoutGroup] 2023-02-12 03:04:01,745 INFO [M:0;jenkins-hbase6:33459] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:04:01,746 INFO [M:0;jenkins-hbase6:33459] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:04:01,746 DEBUG [M:0;jenkins-hbase6:33459] master.HMaster(1502): Stopping service threads 2023-02-12 03:04:01,746 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:01,746 INFO [M:0;jenkins-hbase6:33459] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:04:01,746 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:01,747 ERROR [M:0;jenkins-hbase6:33459] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:04:01,747 INFO [M:0;jenkins-hbase6:33459] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:04:01,747 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:04:01,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:01,747 DEBUG [M:0;jenkins-hbase6:33459] zookeeper.ZKUtil(398): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:04:01,747 WARN [M:0;jenkins-hbase6:33459] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:04:01,747 INFO [M:0;jenkins-hbase6:33459] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:04:01,748 INFO [M:0;jenkins-hbase6:33459] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:04:01,748 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:04:01,748 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:01,748 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:01,748 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:04:01,748 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:01,748 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.06 KB 2023-02-12 03:04:01,757 INFO [M:0;jenkins-hbase6:33459] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ae6e9e671b842cfab120eb0fc0545ae 2023-02-12 03:04:01,761 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1ae6e9e671b842cfab120eb0fc0545ae as hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ae6e9e671b842cfab120eb0fc0545ae 2023-02-12 03:04:01,764 INFO [M:0;jenkins-hbase6:33459] regionserver.HStore(1080): Added hdfs://localhost:34773/user/jenkins/test-data/c9d128ab-fd1d-655d-95ce-087b908123dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1ae6e9e671b842cfab120eb0fc0545ae, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 03:04:01,765 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57474, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-12 03:04:01,765 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:01,765 DEBUG [M:0;jenkins-hbase6:33459] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171041748Disabling compacts and flushes for region at 1676171041748Disabling writes for close at 1676171041748Obtaining lock to block concurrent updates at 1676171041748Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171041748Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57474, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676171041748Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171041749 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171041750 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171041752 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171041752Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171041761 (+9 ms)Finished flush of dataSize ~56.13 KB/57474, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676171041765 (+4 ms)Writing region close event to WAL at 1676171041765Closed at 1676171041765 2023-02-12 03:04:01,769 INFO [M:0;jenkins-hbase6:33459] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:04:01,769 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:01,770 INFO [M:0;jenkins-hbase6:33459] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:33459 2023-02-12 03:04:01,772 DEBUG [M:0;jenkins-hbase6:33459] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,33459,1676171038488 already deleted, retry=false 2023-02-12 03:04:02,130 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:02,130 INFO [M:0;jenkins-hbase6:33459] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,33459,1676171038488; zookeeper connection closed. 2023-02-12 03:04:02,130 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2845b3ac rejected from java.util.concurrent.ThreadPoolExecutor@2c7a327c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:02,132 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): master:33459-0x10154e9834b0000, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:02,133 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d86c78d rejected from java.util.concurrent.ThreadPoolExecutor@2c7a327c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:02,230 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:02,230 INFO [RS:1;jenkins-hbase6:39503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39503,1676171038573; zookeeper connection closed. 2023-02-12 03:04:02,230 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@659c32b5 rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:02,230 DEBUG [Listener at localhost/37931-EventThread] zookeeper.ZKWatcher(600): regionserver:39503-0x10154e9834b0002, quorum=127.0.0.1:60941, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:02,230 ERROR [Listener at localhost/37931-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d3565cc rejected from java.util.concurrent.ThreadPoolExecutor@4c6d2a38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:02,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1439b216] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1439b216 2023-02-12 03:04:02,231 INFO [Listener at localhost/37931] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:04:02,232 WARN [Listener at localhost/37931] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:02,235 INFO [Listener at localhost/37931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:02,311 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:04:02,400 WARN [BP-1163537140-172.31.2.20-1676171037889 heartbeating to localhost/127.0.0.1:34773] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:02,400 WARN [BP-1163537140-172.31.2.20-1676171037889 heartbeating to localhost/127.0.0.1:34773] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1163537140-172.31.2.20-1676171037889 (Datanode Uuid 44ffcc48-2e00-4ae7-a7a7-09253463694e) service to localhost/127.0.0.1:34773 2023-02-12 03:04:02,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/dfs/data/data3/current/BP-1163537140-172.31.2.20-1676171037889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:02,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/dfs/data/data4/current/BP-1163537140-172.31.2.20-1676171037889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:02,404 WARN [Listener at localhost/37931] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:02,407 INFO [Listener at localhost/37931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:02,510 WARN [BP-1163537140-172.31.2.20-1676171037889 heartbeating to localhost/127.0.0.1:34773] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:02,510 WARN [BP-1163537140-172.31.2.20-1676171037889 heartbeating to localhost/127.0.0.1:34773] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1163537140-172.31.2.20-1676171037889 (Datanode Uuid e8bbcee8-3109-4b5b-81e2-fa3b9a9ebb35) service to localhost/127.0.0.1:34773 2023-02-12 03:04:02,511 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/dfs/data/data1/current/BP-1163537140-172.31.2.20-1676171037889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:02,511 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/cluster_7d1da21c-559a-9406-de50-26331a7ffa73/dfs/data/data2/current/BP-1163537140-172.31.2.20-1676171037889] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:02,522 INFO [Listener at localhost/37931] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:02,640 INFO [Listener at localhost/37931] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:04:02,660 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:04:02,672 INFO [Listener at localhost/37931] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 231) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:34773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,33459,1676171038488)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34773 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37931 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:34773 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34773 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37931.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=258 (was 263), ProcessCount=167 (was 167), AvailableMemoryMB=5342 (was 5398) 2023-02-12 03:04:02,683 INFO [Listener at localhost/37931] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=258, ProcessCount=167, AvailableMemoryMB=5342 2023-02-12 03:04:02,693 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.log.dir so I do NOT create it in target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916 2023-02-12 03:04:02,694 WARN [Listener at localhost/37931] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.tmp.dir so I do NOT create it in target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916 2023-02-12 03:04:02,694 WARN [Listener at localhost/37931] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/41e89460-d850-c372-70a3-68a21f313b9d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:04:02,694 DEBUG [Listener at localhost/37931] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439, deleteOnExit=true 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/test.cache.data in system properties and HBase conf 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:04:02,694 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:04:02,695 DEBUG [Listener at localhost/37931] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:04:02,695 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:04:02,696 INFO [Listener at localhost/37931] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:04:02,700 WARN [Listener at localhost/37931] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:04:02,700 WARN [Listener at localhost/37931] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:04:02,739 WARN [Listener at localhost/37931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:02,741 INFO [Listener at localhost/37931] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:02,746 INFO [Listener at localhost/37931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/java.io.tmpdir/Jetty_localhost_35447_hdfs____3354fz/webapp 2023-02-12 03:04:02,838 INFO [Listener at localhost/37931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35447 2023-02-12 03:04:02,842 WARN [Listener at localhost/37931] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:04:02,842 WARN [Listener at localhost/37931] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:04:02,886 WARN [Listener at localhost/35969] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:02,903 WARN [Listener at localhost/35969] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:04:02,905 WARN [Listener at localhost/35969] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:02,906 INFO [Listener at localhost/35969] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:02,910 INFO [Listener at localhost/35969] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/java.io.tmpdir/Jetty_localhost_41677_datanode____.98guxs/webapp 2023-02-12 03:04:03,001 INFO [Listener at localhost/35969] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41677 2023-02-12 03:04:03,009 WARN [Listener at localhost/40847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:03,023 WARN [Listener at localhost/40847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:04:03,025 WARN [Listener at localhost/40847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:03,026 INFO [Listener at localhost/40847] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:03,032 INFO [Listener at localhost/40847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/java.io.tmpdir/Jetty_localhost_37289_datanode____d0smra/webapp 2023-02-12 03:04:03,116 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x667049dd5e2d783f: Processing first storage report for DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0 from datanode a03a978c-4cdc-45d3-ac18-9275b1e22d31 2023-02-12 03:04:03,116 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x667049dd5e2d783f: from storage DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0 node DatanodeRegistration(127.0.0.1:46331, datanodeUuid=a03a978c-4cdc-45d3-ac18-9275b1e22d31, infoPort=40961, infoSecurePort=0, ipcPort=40847, storageInfo=lv=-57;cid=testClusterID;nsid=2131201576;c=1676171042703), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:03,116 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x667049dd5e2d783f: Processing first storage report for DS-4f883e06-becc-4ed9-a8cf-1dd0b1f1f2bc from datanode a03a978c-4cdc-45d3-ac18-9275b1e22d31 2023-02-12 03:04:03,116 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x667049dd5e2d783f: from storage DS-4f883e06-becc-4ed9-a8cf-1dd0b1f1f2bc node DatanodeRegistration(127.0.0.1:46331, datanodeUuid=a03a978c-4cdc-45d3-ac18-9275b1e22d31, infoPort=40961, infoSecurePort=0, ipcPort=40847, storageInfo=lv=-57;cid=testClusterID;nsid=2131201576;c=1676171042703), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:03,135 INFO [Listener at localhost/40847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37289 2023-02-12 03:04:03,142 WARN [Listener at localhost/34261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:03,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58162578b412344f: Processing first storage report for DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2 from datanode b6d66171-2cad-4718-84f8-c3134a525561 2023-02-12 03:04:03,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58162578b412344f: from storage DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2 node DatanodeRegistration(127.0.0.1:37277, datanodeUuid=b6d66171-2cad-4718-84f8-c3134a525561, infoPort=41743, infoSecurePort=0, ipcPort=34261, storageInfo=lv=-57;cid=testClusterID;nsid=2131201576;c=1676171042703), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:03,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x58162578b412344f: Processing first storage report for DS-d04397d2-8df0-45f3-904d-7f5b74a22ac2 from datanode b6d66171-2cad-4718-84f8-c3134a525561 2023-02-12 03:04:03,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x58162578b412344f: from storage DS-d04397d2-8df0-45f3-904d-7f5b74a22ac2 node DatanodeRegistration(127.0.0.1:37277, datanodeUuid=b6d66171-2cad-4718-84f8-c3134a525561, infoPort=41743, infoSecurePort=0, ipcPort=34261, storageInfo=lv=-57;cid=testClusterID;nsid=2131201576;c=1676171042703), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:03,350 DEBUG [Listener at localhost/34261] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916 2023-02-12 03:04:03,352 INFO [Listener at localhost/34261] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/zookeeper_0, clientPort=63273, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:04:03,354 INFO [Listener at localhost/34261] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63273 2023-02-12 03:04:03,354 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,355 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,368 INFO [Listener at localhost/34261] util.FSUtils(479): Created version file at hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83 with version=8 2023-02-12 03:04:03,369 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,370 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,371 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35969/user/jenkins/test-data/29376878-a2a6-84bb-9d0b-1f048c7c11fc/hbase-staging 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:03,373 INFO [Listener at localhost/34261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:03,374 INFO [Listener at localhost/34261] ipc.NettyRpcServer(120): Bind to /172.31.2.20:40275 2023-02-12 03:04:03,374 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,375 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,376 INFO [Listener at localhost/34261] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40275 connecting to ZooKeeper ensemble=127.0.0.1:63273 2023-02-12 03:04:03,384 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:402750x0, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:03,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40275-0x10154e9965d0000 connected 2023-02-12 03:04:03,400 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:03,400 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:03,401 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:03,402 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40275 2023-02-12 03:04:03,406 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40275 2023-02-12 03:04:03,407 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40275 2023-02-12 03:04:03,407 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40275 2023-02-12 03:04:03,410 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40275 2023-02-12 03:04:03,410 INFO [Listener at localhost/34261] master.HMaster(439): hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83, hbase.cluster.distributed=false 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:03,423 INFO [Listener at localhost/34261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:03,424 INFO [Listener at localhost/34261] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46415 2023-02-12 03:04:03,424 INFO [Listener at localhost/34261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:04:03,425 DEBUG [Listener at localhost/34261] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:03,425 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,426 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,427 INFO [Listener at localhost/34261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46415 connecting to ZooKeeper ensemble=127.0.0.1:63273 2023-02-12 03:04:03,430 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:464150x0, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:03,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46415-0x10154e9965d0001 connected 2023-02-12 03:04:03,431 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:03,431 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:03,432 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:03,434 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46415 2023-02-12 03:04:03,434 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46415 2023-02-12 03:04:03,434 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46415 2023-02-12 03:04:03,436 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46415 2023-02-12 03:04:03,437 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46415 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:03,448 INFO [Listener at localhost/34261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:03,449 INFO [Listener at localhost/34261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:03,450 INFO [Listener at localhost/34261] ipc.NettyRpcServer(120): Bind to /172.31.2.20:39701 2023-02-12 03:04:03,450 INFO [Listener at localhost/34261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:04:03,453 DEBUG [Listener at localhost/34261] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:03,454 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,455 INFO [Listener at localhost/34261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,456 INFO [Listener at localhost/34261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39701 connecting to ZooKeeper ensemble=127.0.0.1:63273 2023-02-12 03:04:03,460 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:397010x0, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:03,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39701-0x10154e9965d0002 connected 2023-02-12 03:04:03,462 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:03,462 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:03,462 DEBUG [Listener at localhost/34261] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:03,464 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39701 2023-02-12 03:04:03,466 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39701 2023-02-12 03:04:03,466 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39701 2023-02-12 03:04:03,468 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39701 2023-02-12 03:04:03,470 DEBUG [Listener at localhost/34261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39701 2023-02-12 03:04:03,475 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,476 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:04:03,477 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,478 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:03,478 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:03,478 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:03,479 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,480 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:04:03,482 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,40275,1676171043372 from backup master directory 2023-02-12 03:04:03,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:04:03,484 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,484 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:04:03,484 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:03,485 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,499 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/hbase.id with ID: eb07e46e-0b02-4df8-8dae-ed249df70973 2023-02-12 03:04:03,509 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:03,511 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,523 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x77bd30ca to 127.0.0.1:63273 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:03,529 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53411e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:03,529 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:03,529 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:04:03,529 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:03,531 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store-tmp 2023-02-12 03:04:03,538 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:03,538 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:04:03,538 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:03,539 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:03,539 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:04:03,539 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:03,539 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:03,539 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171043538Disabling compacts and flushes for region at 1676171043538Disabling writes for close at 1676171043539 (+1 ms)Writing region close event to WAL at 1676171043539Closed at 1676171043539 2023-02-12 03:04:03,539 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/WALs/jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,541 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C40275%2C1676171043372, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/WALs/jenkins-hbase6.apache.org,40275,1676171043372, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/oldWALs, maxLogs=10 2023-02-12 03:04:03,553 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK] 2023-02-12 03:04:03,553 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK] 2023-02-12 03:04:03,555 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/WALs/jenkins-hbase6.apache.org,40275,1676171043372/jenkins-hbase6.apache.org%2C40275%2C1676171043372.1676171043541 2023-02-12 03:04:03,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK], DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK]] 2023-02-12 03:04:03,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:03,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:03,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,556 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,557 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:04:03,558 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:04:03,558 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,559 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,559 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,561 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:03,562 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:03,562 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66089504, jitterRate=-0.015189647674560547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:04:03,562 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171043555Initializing all the Stores at 1676171043556 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171043556Cleaning up temporary data from old regions at 1676171043559 (+3 ms)Cleaning up detritus from prior splits at 1676171043560 (+1 ms)Region opened successfully at 1676171043562 (+2 ms) 2023-02-12 03:04:03,563 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:04:03,564 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:04:03,564 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:04:03,564 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:04:03,564 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:04:03,565 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:04:03,565 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:04:03,565 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:04:03,566 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:04:03,576 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:04:03,576 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:04:03,576 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:04:03,576 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:04:03,576 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:04:03,578 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,578 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:04:03,579 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:04:03,579 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:04:03,582 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:03,582 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:03,582 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:03,582 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,582 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,40275,1676171043372, sessionid=0x10154e9965d0000, setting cluster-up flag (Was=false) 2023-02-12 03:04:03,587 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,591 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:04:03,592 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,594 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,599 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:04:03,599 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:03,600 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/.tmp 2023-02-12 03:04:03,603 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:03,604 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,608 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171073608 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:04:03,609 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,609 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:03,609 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:04:03,610 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:04:03,610 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:04:03,610 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:04:03,610 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:04:03,610 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:04:03,611 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171043610,5,FailOnTimeoutGroup] 2023-02-12 03:04:03,611 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171043611,5,FailOnTimeoutGroup] 2023-02-12 03:04:03,611 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,611 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:04:03,611 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,611 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,611 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:03,620 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:03,620 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:03,620 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83 2023-02-12 03:04:03,627 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:03,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:04:03,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/info 2023-02-12 03:04:03,629 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:04:03,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:04:03,630 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:03,630 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:04:03,631 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,631 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:04:03,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/table 2023-02-12 03:04:03,632 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:04:03,632 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,632 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740 2023-02-12 03:04:03,633 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740 2023-02-12 03:04:03,634 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:04:03,635 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:04:03,636 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:03,637 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66834432, jitterRate=-0.00408935546875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171043627Initializing all the Stores at 1676171043627Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171043627Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171043627Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171043627Cleaning up temporary data from old regions at 1676171043633 (+6 ms)Cleaning up detritus from prior splits at 1676171043634 (+1 ms)Region opened successfully at 1676171043637 (+3 ms) 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:04:03,637 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:04:03,637 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:03,637 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171043637Disabling compacts and flushes for region at 1676171043637Disabling writes for close at 1676171043637Writing region close event to WAL at 1676171043637Closed at 1676171043637 2023-02-12 03:04:03,638 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:03,638 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:04:03,638 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:04:03,640 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:04:03,641 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:04:03,672 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(952): ClusterId : eb07e46e-0b02-4df8-8dae-ed249df70973 2023-02-12 03:04:03,672 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(952): ClusterId : eb07e46e-0b02-4df8-8dae-ed249df70973 2023-02-12 03:04:03,673 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:04:03,673 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:04:03,674 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:04:03,674 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:04:03,674 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:04:03,675 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:04:03,678 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:04:03,679 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:04:03,680 DEBUG [RS:0;jenkins-hbase6:46415] zookeeper.ReadOnlyZKClient(139): Connect 0x659d02c5 to 127.0.0.1:63273 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:03,680 DEBUG [RS:1;jenkins-hbase6:39701] zookeeper.ReadOnlyZKClient(139): Connect 0x429246ea to 127.0.0.1:63273 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:03,685 DEBUG [RS:0;jenkins-hbase6:46415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b5ae006, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:03,685 DEBUG [RS:0;jenkins-hbase6:46415] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f6569b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:03,685 DEBUG [RS:1;jenkins-hbase6:39701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c55a0c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:03,685 DEBUG [RS:1;jenkins-hbase6:39701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@486a2d9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:03,694 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:39701 2023-02-12 03:04:03,694 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:46415 2023-02-12 03:04:03,694 INFO [RS:1;jenkins-hbase6:39701] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:04:03,694 INFO [RS:1;jenkins-hbase6:39701] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:04:03,694 INFO [RS:0;jenkins-hbase6:46415] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:04:03,694 INFO [RS:0;jenkins-hbase6:46415] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:04:03,694 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:04:03,694 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:04:03,695 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40275,1676171043372 with isa=jenkins-hbase6.apache.org/172.31.2.20:39701, startcode=1676171043447 2023-02-12 03:04:03,695 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,40275,1676171043372 with isa=jenkins-hbase6.apache.org/172.31.2.20:46415, startcode=1676171043422 2023-02-12 03:04:03,695 DEBUG [RS:0;jenkins-hbase6:46415] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:04:03,695 DEBUG [RS:1;jenkins-hbase6:39701] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:04:03,697 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52105, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:04:03,697 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:44567, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:04:03,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40275] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,699 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83 2023-02-12 03:04:03,699 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83 2023-02-12 03:04:03,699 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35969 2023-02-12 03:04:03,699 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35969 2023-02-12 03:04:03,700 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:04:03,700 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:04:03,702 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:03,706 DEBUG [RS:0;jenkins-hbase6:46415] zookeeper.ZKUtil(162): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,706 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,46415,1676171043422] 2023-02-12 03:04:03,707 WARN [RS:0;jenkins-hbase6:46415] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:03,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,39701,1676171043447] 2023-02-12 03:04:03,707 DEBUG [RS:1;jenkins-hbase6:39701] zookeeper.ZKUtil(162): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,707 INFO [RS:0;jenkins-hbase6:46415] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:03,707 WARN [RS:1;jenkins-hbase6:39701] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:03,707 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,707 INFO [RS:1;jenkins-hbase6:39701] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:03,707 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,711 DEBUG [RS:1;jenkins-hbase6:39701] zookeeper.ZKUtil(162): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,711 DEBUG [RS:0;jenkins-hbase6:46415] zookeeper.ZKUtil(162): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,712 DEBUG [RS:1;jenkins-hbase6:39701] zookeeper.ZKUtil(162): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,712 DEBUG [RS:0;jenkins-hbase6:46415] zookeeper.ZKUtil(162): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,712 DEBUG [RS:1;jenkins-hbase6:39701] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:04:03,712 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:04:03,712 INFO [RS:1;jenkins-hbase6:39701] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:04:03,713 INFO [RS:0;jenkins-hbase6:46415] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:04:03,714 INFO [RS:1;jenkins-hbase6:39701] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:04:03,714 INFO [RS:1;jenkins-hbase6:39701] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:04:03,714 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,715 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:04:03,716 INFO [RS:0;jenkins-hbase6:46415] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:04:03,718 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,718 INFO [RS:0;jenkins-hbase6:46415] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:04:03,718 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,718 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,719 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:03,719 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,720 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,720 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,720 DEBUG [RS:1;jenkins-hbase6:39701] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,721 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,721 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,721 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,721 DEBUG [RS:0;jenkins-hbase6:46415] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:03,722 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,722 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,722 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,733 INFO [RS:1;jenkins-hbase6:39701] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:04:03,733 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,39701,1676171043447-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,736 INFO [RS:0;jenkins-hbase6:46415] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:04:03,736 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46415,1676171043422-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:03,743 INFO [RS:1;jenkins-hbase6:39701] regionserver.Replication(203): jenkins-hbase6.apache.org,39701,1676171043447 started 2023-02-12 03:04:03,744 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,39701,1676171043447, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:39701, sessionid=0x10154e9965d0002 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39701,1676171043447' 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:04:03,744 DEBUG [RS:1;jenkins-hbase6:39701] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:03,745 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,39701,1676171043447' 2023-02-12 03:04:03,745 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:03,745 DEBUG [RS:1;jenkins-hbase6:39701] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:03,745 DEBUG [RS:1;jenkins-hbase6:39701] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:04:03,745 INFO [RS:1;jenkins-hbase6:39701] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:04:03,745 INFO [RS:1;jenkins-hbase6:39701] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:04:03,752 INFO [RS:0;jenkins-hbase6:46415] regionserver.Replication(203): jenkins-hbase6.apache.org,46415,1676171043422 started 2023-02-12 03:04:03,752 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,46415,1676171043422, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:46415, sessionid=0x10154e9965d0001 2023-02-12 03:04:03,752 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:04:03,752 DEBUG [RS:0;jenkins-hbase6:46415] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46415,1676171043422' 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,46415,1676171043422' 2023-02-12 03:04:03,753 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:03,754 DEBUG [RS:0;jenkins-hbase6:46415] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:03,754 DEBUG [RS:0;jenkins-hbase6:46415] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:04:03,754 INFO [RS:0;jenkins-hbase6:46415] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:04:03,754 INFO [RS:0;jenkins-hbase6:46415] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:04:03,792 DEBUG [jenkins-hbase6:40275] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:04:03,792 DEBUG [jenkins-hbase6:40275] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:03,794 DEBUG [jenkins-hbase6:40275] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:03,794 DEBUG [jenkins-hbase6:40275] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:03,794 DEBUG [jenkins-hbase6:40275] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:03,794 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46415,1676171043422, state=OPENING 2023-02-12 03:04:03,795 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:04:03,802 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:03,802 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:04:03,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46415,1676171043422}] 2023-02-12 03:04:03,957 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:03,957 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:04:03,959 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:04:03,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:04:03,963 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:03,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46415%2C1676171043422.meta, suffix=.meta, logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,46415,1676171043422, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs, maxLogs=32 2023-02-12 03:04:03,977 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK] 2023-02-12 03:04:03,977 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK] 2023-02-12 03:04:03,979 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,46415,1676171043422/jenkins-hbase6.apache.org%2C46415%2C1676171043422.meta.1676171043964.meta 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK], DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK]] 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:04:03,982 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:04:03,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:04:03,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:04:03,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/info 2023-02-12 03:04:03,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/info 2023-02-12 03:04:03,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:04:03,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:04:03,986 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:03,986 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:03,986 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:04:03,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:04:03,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/table 2023-02-12 03:04:03,987 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/table 2023-02-12 03:04:03,987 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:04:03,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:03,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740 2023-02-12 03:04:03,989 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740 2023-02-12 03:04:03,990 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:04:03,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:04:03,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69567102, jitterRate=0.036630600690841675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:04:03,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171043983Writing region info on filesystem at 1676171043983Initializing all the Stores at 1676171043983Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171043983Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171043983Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171043983Cleaning up temporary data from old regions at 1676171043990 (+7 ms)Cleaning up detritus from prior splits at 1676171043990Running coprocessor post-open hooks at 1676171043992 (+2 ms)Region opened successfully at 1676171043992 2023-02-12 03:04:03,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171043957 2023-02-12 03:04:03,996 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:04:03,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:04:03,997 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,46415,1676171043422, state=OPEN 2023-02-12 03:04:03,998 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:04:03,998 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:04:04,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:04:04,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,46415,1676171043422 in 196 msec 2023-02-12 03:04:04,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:04:04,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-12 03:04:04,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-12 03:04:04,002 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171043477, completionTime=-1 2023-02-12 03:04:04,002 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:04:04,002 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:04:04,005 DEBUG [hconnection-0x505a1e41-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:04,006 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:04,008 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:04:04,008 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171104008 2023-02-12 03:04:04,008 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171164008 2023-02-12 03:04:04,008 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 03:04:04,016 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40275,1676171043372-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:04,016 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40275,1676171043372-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:04,016 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40275,1676171043372-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:04,017 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:40275, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:04,017 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:04,017 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:04:04,017 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:04,018 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:04:04,019 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:04:04,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:04:04,020 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:04:04,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/hbase/namespace/4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/hbase/namespace/4f654da9531c40e3cec43114dd518993 empty. 2023-02-12 03:04:04,021 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/hbase/namespace/4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,022 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:04:04,033 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:04,034 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4f654da9531c40e3cec43114dd518993, NAME => 'hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4f654da9531c40e3cec43114dd518993, disabling compactions & flushes 2023-02-12 03:04:04,040 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. after waiting 0 ms 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,040 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,040 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4f654da9531c40e3cec43114dd518993: Waiting for close lock at 1676171044040Disabling compacts and flushes for region at 1676171044040Disabling writes for close at 1676171044040Writing region close event to WAL at 1676171044040Closed at 1676171044040 2023-02-12 03:04:04,043 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:04:04,043 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171044043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171044043"}]},"ts":"1676171044043"} 2023-02-12 03:04:04,045 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:04:04,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:04:04,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171044046"}]},"ts":"1676171044046"} 2023-02-12 03:04:04,047 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:04:04,050 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:04,051 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:04,051 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:04,051 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:04,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4f654da9531c40e3cec43114dd518993, ASSIGN}] 2023-02-12 03:04:04,054 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4f654da9531c40e3cec43114dd518993, ASSIGN 2023-02-12 03:04:04,055 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4f654da9531c40e3cec43114dd518993, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46415,1676171043422; forceNewPlan=false, retain=false 2023-02-12 03:04:04,205 INFO [jenkins-hbase6:40275] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:04:04,205 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4f654da9531c40e3cec43114dd518993, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:04,205 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171044205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171044205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171044205"}]},"ts":"1676171044205"} 2023-02-12 03:04:04,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4f654da9531c40e3cec43114dd518993, server=jenkins-hbase6.apache.org,46415,1676171043422}] 2023-02-12 03:04:04,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46415%2C1676171043422, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,46415,1676171043422, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs, maxLogs=32 2023-02-12 03:04:04,375 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK] 2023-02-12 03:04:04,375 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK] 2023-02-12 03:04:04,377 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,46415,1676171043422/jenkins-hbase6.apache.org%2C46415%2C1676171043422.1676171044363 2023-02-12 03:04:04,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK], DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK]] 2023-02-12 03:04:04,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4f654da9531c40e3cec43114dd518993, NAME => 'hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:04,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:04,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,379 INFO [StoreOpener-4f654da9531c40e3cec43114dd518993-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,380 DEBUG [StoreOpener-4f654da9531c40e3cec43114dd518993-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/info 2023-02-12 03:04:04,380 DEBUG [StoreOpener-4f654da9531c40e3cec43114dd518993-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/info 2023-02-12 03:04:04,380 INFO [StoreOpener-4f654da9531c40e3cec43114dd518993-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f654da9531c40e3cec43114dd518993 columnFamilyName info 2023-02-12 03:04:04,381 INFO [StoreOpener-4f654da9531c40e3cec43114dd518993-1] regionserver.HStore(310): Store=4f654da9531c40e3cec43114dd518993/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:04,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:04,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:04,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 4f654da9531c40e3cec43114dd518993; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71273624, jitterRate=0.062059760093688965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:04:04,385 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 4f654da9531c40e3cec43114dd518993: Running coprocessor pre-open hook at 1676171044378Writing region info on filesystem at 1676171044378Initializing all the Stores at 1676171044379 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171044379Cleaning up temporary data from old regions at 1676171044382 (+3 ms)Cleaning up detritus from prior splits at 1676171044382Running coprocessor post-open hooks at 1676171044385 (+3 ms)Region opened successfully at 1676171044385 2023-02-12 03:04:04,386 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993., pid=6, masterSystemTime=1676171044359 2023-02-12 03:04:04,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,387 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:04,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4f654da9531c40e3cec43114dd518993, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:04,388 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171044387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171044387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171044387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171044387"}]},"ts":"1676171044387"} 2023-02-12 03:04:04,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:04:04,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4f654da9531c40e3cec43114dd518993, server=jenkins-hbase6.apache.org,46415,1676171043422 in 182 msec 2023-02-12 03:04:04,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:04:04,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4f654da9531c40e3cec43114dd518993, ASSIGN in 339 msec 2023-02-12 03:04:04,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:04:04,392 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171044392"}]},"ts":"1676171044392"} 2023-02-12 03:04:04,393 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:04:04,395 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:04:04,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-12 03:04:04,419 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:04:04,420 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:04,420 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:04,424 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:04:04,432 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:04,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-12 03:04:04,446 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:04:04,452 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:04,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 03:04:04,460 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:04:04,462 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:04:04,462 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.977sec 2023-02-12 03:04:04,462 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:04:04,462 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:04:04,462 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:04:04,462 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40275,1676171043372-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:04:04,463 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,40275,1676171043372-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:04:04,464 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:04:04,473 DEBUG [Listener at localhost/34261] zookeeper.ReadOnlyZKClient(139): Connect 0x30d52a58 to 127.0.0.1:63273 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:04,482 DEBUG [Listener at localhost/34261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37784f98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:04,483 DEBUG [hconnection-0x37efc43f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:04,485 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:04,486 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:04,487 DEBUG [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:04:04,489 DEBUG [Listener at localhost/34261] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:04:04,490 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:40490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:04:04,491 INFO [Listener at localhost/34261] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:04,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:04,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:04:04,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.2.20:40490 deadline: 1676171104491, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:04,492 INFO [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 03:04:04,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:04,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:04,496 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:04:04,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-12 03:04:04,497 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:04:04,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:04,499 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,499 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 empty. 2023-02-12 03:04:04,499 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,499 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 03:04:04,508 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:04,509 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => d4f87bec35c8b30b91547b768f5df7d8, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp 2023-02-12 03:04:04,515 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:04,516 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing d4f87bec35c8b30b91547b768f5df7d8, disabling compactions & flushes 2023-02-12 03:04:04,516 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,516 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,516 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. after waiting 0 ms 2023-02-12 03:04:04,516 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,516 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,516 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for d4f87bec35c8b30b91547b768f5df7d8: Waiting for close lock at 1676171044516Disabling compacts and flushes for region at 1676171044516Disabling writes for close at 1676171044516Writing region close event to WAL at 1676171044516Closed at 1676171044516 2023-02-12 03:04:04,518 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:04:04,519 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676171044519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171044519"}]},"ts":"1676171044519"} 2023-02-12 03:04:04,520 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:04:04,522 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:04:04,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171044522"}]},"ts":"1676171044522"} 2023-02-12 03:04:04,523 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-12 03:04:04,526 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:04,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:04,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:04,527 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:04,527 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, ASSIGN}] 2023-02-12 03:04:04,529 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, ASSIGN 2023-02-12 03:04:04,530 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,46415,1676171043422; forceNewPlan=false, retain=false 2023-02-12 03:04:04,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:04,680 INFO [jenkins-hbase6:40275] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:04:04,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d4f87bec35c8b30b91547b768f5df7d8, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:04,681 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676171044680"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171044680"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171044680"}]},"ts":"1676171044680"} 2023-02-12 03:04:04,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d4f87bec35c8b30b91547b768f5df7d8, server=jenkins-hbase6.apache.org,46415,1676171043422}] 2023-02-12 03:04:04,747 INFO [RS:1;jenkins-hbase6:39701] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C39701%2C1676171043447, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,39701,1676171043447, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs, maxLogs=32 2023-02-12 03:04:04,763 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK] 2023-02-12 03:04:04,763 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK] 2023-02-12 03:04:04,765 INFO [RS:1;jenkins-hbase6:39701] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/WALs/jenkins-hbase6.apache.org,39701,1676171043447/jenkins-hbase6.apache.org%2C39701%2C1676171043447.1676171044747 2023-02-12 03:04:04,765 DEBUG [RS:1;jenkins-hbase6:39701] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46331,DS-7b4d1daa-ce50-40cd-8cd0-87f8e92d97e0,DISK], DatanodeInfoWithStorage[127.0.0.1:37277,DS-735d1cb7-ff13-4418-9185-f0176d2bdfa2,DISK]] 2023-02-12 03:04:04,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:04,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d4f87bec35c8b30b91547b768f5df7d8, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:04,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:04,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,839 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,840 DEBUG [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1 2023-02-12 03:04:04,840 DEBUG [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1 2023-02-12 03:04:04,840 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4f87bec35c8b30b91547b768f5df7d8 columnFamilyName f1 2023-02-12 03:04:04,841 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] regionserver.HStore(310): Store=d4f87bec35c8b30b91547b768f5df7d8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:04,841 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,842 DEBUG [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2 2023-02-12 03:04:04,842 DEBUG [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2 2023-02-12 03:04:04,842 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4f87bec35c8b30b91547b768f5df7d8 columnFamilyName f2 2023-02-12 03:04:04,843 INFO [StoreOpener-d4f87bec35c8b30b91547b768f5df7d8-1] regionserver.HStore(310): Store=d4f87bec35c8b30b91547b768f5df7d8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:04:04,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:04,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened d4f87bec35c8b30b91547b768f5df7d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72680238, jitterRate=0.08301994204521179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:04:04,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for d4f87bec35c8b30b91547b768f5df7d8: Running coprocessor pre-open hook at 1676171044838Writing region info on filesystem at 1676171044838Initializing all the Stores at 1676171044839 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171044839Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171044839Cleaning up temporary data from old regions at 1676171044844 (+5 ms)Cleaning up detritus from prior splits at 1676171044845 (+1 ms)Running coprocessor post-open hooks at 1676171044848 (+3 ms)Region opened successfully at 1676171044848 2023-02-12 03:04:04,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8., pid=12, masterSystemTime=1676171044834 2023-02-12 03:04:04,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:04,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d4f87bec35c8b30b91547b768f5df7d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:04,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676171044851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171044851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171044851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171044851"}]},"ts":"1676171044851"} 2023-02-12 03:04:04,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 03:04:04,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d4f87bec35c8b30b91547b768f5df7d8, server=jenkins-hbase6.apache.org,46415,1676171043422 in 169 msec 2023-02-12 03:04:04,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 03:04:04,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, ASSIGN in 327 msec 2023-02-12 03:04:04,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:04:04,856 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171044856"}]},"ts":"1676171044856"} 2023-02-12 03:04:04,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-12 03:04:04,859 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:04:04,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 365 msec 2023-02-12 03:04:05,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:05,102 INFO [Listener at localhost/34261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-12 03:04:05,103 DEBUG [Listener at localhost/34261] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-12 03:04:05,103 INFO [Listener at localhost/34261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:05,105 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-12 03:04:05,105 INFO [Listener at localhost/34261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:05,105 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-12 03:04:05,105 INFO [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:04:05,136 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46415] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,305 INFO [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:04:05,305 INFO [Listener at localhost/34261] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:04:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 03:04:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171045306 (current time:1676171045306). 2023-02-12 03:04:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:04:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] zookeeper.ReadOnlyZKClient(139): Connect 0x34600da0 to 127.0.0.1:63273 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:05,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a16f535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:05,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:05,313 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37270, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:05,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34600da0 to 127.0.0.1:63273 2023-02-12 03:04:05,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:05,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:04:05,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 03:04:05,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 03:04:05,318 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 03:04:05,319 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676171645319 2023-02-12 03:04:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 03:04:05,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,322 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 03:04:05,322 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:05,322 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:04:05,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 03:04:05,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-12 03:04:05,324 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 03:04:05,324 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676171645324 2023-02-12 03:04:05,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 03:04:05,332 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 03:04:05,332 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:05,333 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 03:04:05,333 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 03:04:05,334 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,334 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,335 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:05,335 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:05,335 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:05,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:05,335 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,335 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 03:04:05,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 03:04:05,337 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 03:04:05,337 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:05,343 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 03:04:05,343 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 03:04:05,343 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46415,1676171043422' joining acquired barrier for procedure (foo) in zk 2023-02-12 03:04:05,343 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 03:04:05,343 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:05,344 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 03:04:05,344 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 03:04:05,344 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39701,1676171043447' joining acquired barrier for procedure (foo) in zk 2023-02-12 03:04:05,345 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,345 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:05,347 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,347 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,347 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:05,347 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,348 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46415,1676171043422' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 03:04:05,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@662659bd[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:05,349 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 03:04:05,349 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 03:04:05,350 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,350 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,39701,1676171043447' in zk 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 03:04:05,350 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:04:05,351 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,351 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. started... 2023-02-12 03:04:05,351 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d4f87bec35c8b30b91547b768f5df7d8 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 03:04:05,352 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 03:04:05,352 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,352 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 03:04:05,367 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 2023-02-12 03:04:05,384 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f2/e91cb31e0aab4dcfa6824488d6528105 2023-02-12 03:04:05,388 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 2023-02-12 03:04:05,392 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:05,393 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f2/e91cb31e0aab4dcfa6824488d6528105 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105 2023-02-12 03:04:05,397 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:05,398 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d4f87bec35c8b30b91547b768f5df7d8 in 47ms, sequenceid=5, compaction requested=false 2023-02-12 03:04:05,398 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 03:04:05,398 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d4f87bec35c8b30b91547b768f5df7d8: 2023-02-12 03:04:05,398 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.' region-info for snapshot=foo 2023-02-12 03:04:05,398 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:04:05,399 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4] hfiles 2023-02-12 03:04:05,399 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 for snapshot=foo 2023-02-12 03:04:05,399 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105] hfiles 2023-02-12 03:04:05,399 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105 for snapshot=foo 2023-02-12 03:04:05,409 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. completed. 2023-02-12 03:04:05,409 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,409 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 03:04:05,409 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 03:04:05,409 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,409 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 03:04:05,409 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase6.apache.org,46415,1676171043422' in zk 2023-02-12 03:04:05,411 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,411 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 03:04:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:05,411 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,411 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 03:04:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase6.apache.org,46415,1676171043422': 2023-02-12 03:04:05,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46415,1676171043422' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 03:04:05,414 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 03:04:05,415 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:05,415 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:05,415 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 03:04:05,415 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:04:05,417 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,417 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:05,417 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,417 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:05,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,418 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,418 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:05,419 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,420 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,420 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 03:04:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,423 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:05,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 03:04:05,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:04:05,424 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:05,426 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:05,426 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 03:04:05,426 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 03:04:05,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 03:04:05,427 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:05,427 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,427 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,427 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 03:04:05,427 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 03:04:05,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:05,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/.tmp/foo 2023-02-12 03:04:05,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/.tmp/foo to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/foo 2023-02-12 03:04:05,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-12 03:04:05,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/.tmp/foo 2023-02-12 03:04:05,455 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.hbase-snapshot/.tmp/foo 2023-02-12 03:04:05,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676171045320Consolidate snapshot: foo at 1676171045427 (+107 ms)Loading Region manifests for foo at 1676171045427Writing data manifest for foo at 1676171045430 (+3 ms)Verifying snapshot: foo at 1676171045435 (+5 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676171045455 (+20 ms) 2023-02-12 03:04:05,457 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 03:04:05,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 136 msec 2023-02-12 03:04:05,624 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:05,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 03:04:05,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:04:05,626 INFO [Listener at localhost/34261] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:04:05,629 INFO [Listener at localhost/34261] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:04:05,634 INFO [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:04:05,661 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46415] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,746 INFO [Listener at localhost/34261] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:04:05,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:04:05,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,753 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 03:04:05,753 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:05,754 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-12 03:04:05,754 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-12 03:04:05,755 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,755 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,756 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:05,756 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:05,756 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:05,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:05,756 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,756 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:05,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,758 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 03:04:05,758 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:05,759 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 03:04:05,759 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 03:04:05,759 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:05,759 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:04:05,760 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 03:04:05,760 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,760 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. started... 2023-02-12 03:04:05,760 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 03:04:05,760 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,39701,1676171043447' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 03:04:05,760 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:04:05,760 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d4f87bec35c8b30b91547b768f5df7d8 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 03:04:05,763 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,763 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,763 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:05,774 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f1/fb9e5aa39d7e46118c65fc22e5587f24 2023-02-12 03:04:05,793 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 2023-02-12 03:04:05,797 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f1/fb9e5aa39d7e46118c65fc22e5587f24 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/fb9e5aa39d7e46118c65fc22e5587f24 2023-02-12 03:04:05,801 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/fb9e5aa39d7e46118c65fc22e5587f24, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:05,801 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/.tmp/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 2023-02-12 03:04:05,805 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:05,805 INFO [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d4f87bec35c8b30b91547b768f5df7d8 in 45ms, sequenceid=9, compaction requested=false 2023-02-12 03:04:05,807 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d4f87bec35c8b30b91547b768f5df7d8: 2023-02-12 03:04:05,807 DEBUG [rs(jenkins-hbase6.apache.org,46415,1676171043422)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,807 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:04:05,807 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:04:05,807 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,807 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 03:04:05,807 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,46415,1676171043422' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 03:04:05,808 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,808 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:05,809 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,809 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,46415,1676171043422' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-12 03:04:05,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6219c1a1[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:05,810 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-12 03:04:05,810 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase6.apache.org,46415,1676171043422' in zk 2023-02-12 03:04:05,812 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase6.apache.org,39701,1676171043447' in zk 2023-02-12 03:04:05,812 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,812 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:05,813 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,813 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 03:04:05,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:05,813 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,814 DEBUG [member: 'jenkins-hbase6.apache.org,46415,1676171043422' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 03:04:05,815 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 03:04:05,815 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,815 DEBUG [member: 'jenkins-hbase6.apache.org,39701,1676171043447' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 03:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase6.apache.org,46415,1676171043422': 2023-02-12 03:04:05,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,46415,1676171043422' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-12 03:04:05,817 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-12 03:04:05,817 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:05,817 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:05,817 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,818 INFO [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:04:05,819 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,819 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:05,819 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:05,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,819 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,820 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:05,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:05,820 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,821 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:05,822 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,822 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:05,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 03:04:05,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:04:05,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:05,825 DEBUG [(jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:05,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:05,825 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,826 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,826 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:05,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:05,826 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:04:05,826 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:05,826 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:05,926 DEBUG [Listener at localhost/34261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:04:05,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:04:05,932 INFO [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676171045306 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:05,932 DEBUG [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35969/user/jenkins/test-data/29376878-a2a6-84bb-9d0b-1f048c7c11fc/foo/4c5f5f97-1853-4dca-8d7a-57ecb48b458c/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,932 INFO [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(239): region to add: d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:05,932 INFO [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(585): clone region=d4f87bec35c8b30b91547b768f5df7d8 as d4f87bec35c8b30b91547b768f5df7d8 in snapshot foo 2023-02-12 03:04:05,933 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d4f87bec35c8b30b91547b768f5df7d8, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/29376878-a2a6-84bb-9d0b-1f048c7c11fc/foo/4c5f5f97-1853-4dca-8d7a-57ecb48b458c 2023-02-12 03:04:05,945 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:05,945 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e8b4760dbfe7412dbc6cbf251ef4fcf4 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,947 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e91cb31e0aab4dcfa6824488d6528105 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,949 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d4f87bec35c8b30b91547b768f5df7d8, disabling compactions & flushes 2023-02-12 03:04:05,949 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,949 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,949 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. after waiting 0 ms 2023-02-12 03:04:05,949 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,949 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:05,949 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d4f87bec35c8b30b91547b768f5df7d8: Waiting for close lock at 1676171045949Disabling compacts and flushes for region at 1676171045949Disabling writes for close at 1676171045949Writing region close event to WAL at 1676171045949Closed at 1676171045949 2023-02-12 03:04:05,952 INFO [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676171045306 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:05,952 DEBUG [Listener at localhost/34261] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35969/user/jenkins/test-data/29376878-a2a6-84bb-9d0b-1f048c7c11fc/foo/4c5f5f97-1853-4dca-8d7a-57ecb48b458c 2023-02-12 03:04:05,952 DEBUG [Listener at localhost/34261] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35969/user/jenkins/test-data/29376878-a2a6-84bb-9d0b-1f048c7c11fc/foo/4c5f5f97-1853-4dca-8d7a-57ecb48b458c 2023-02-12 03:04:05,953 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |-data/ 2023-02-12 03:04:05,953 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |----default/ 2023-02-12 03:04:05,953 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-12 03:04:05,954 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |----------d4f87bec35c8b30b91547b768f5df7d8/ 2023-02-12 03:04:05,954 DEBUG [Listener at localhost/34261] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:04:05,954 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:04:05,955 DEBUG [Listener at localhost/34261] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=d4f87bec35c8b30b91547b768f5df7d8-e8b4760dbfe7412dbc6cbf251ef4fcf4 2023-02-12 03:04:05,955 DEBUG [Listener at localhost/34261] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:04:05,955 DEBUG [Listener at localhost/34261] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=d4f87bec35c8b30b91547b768f5df7d8-e91cb31e0aab4dcfa6824488d6528105 hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/fb9e5aa39d7e46118c65fc22e5587f24 hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105 2023-02-12 03:04:05,961 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "foo" 2023-02-12 03:04:05,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 03:04:05,964 INFO [Listener at localhost/34261] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,965 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:05,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:05,969 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171045969"}]},"ts":"1676171045969"} 2023-02-12 03:04:05,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-12 03:04:05,972 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-12 03:04:05,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, UNASSIGN}] 2023-02-12 03:04:05,974 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, UNASSIGN 2023-02-12 03:04:05,975 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d4f87bec35c8b30b91547b768f5df7d8, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:05,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676171045975"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171045975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171045975"}]},"ts":"1676171045975"} 2023-02-12 03:04:05,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d4f87bec35c8b30b91547b768f5df7d8, server=jenkins-hbase6.apache.org,46415,1676171043422}] 2023-02-12 03:04:06,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:06,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:06,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing d4f87bec35c8b30b91547b768f5df7d8, disabling compactions & flushes 2023-02-12 03:04:06,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:06,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:06,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. after waiting 0 ms 2023-02-12 03:04:06,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:06,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:04:06,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8. 2023-02-12 03:04:06,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for d4f87bec35c8b30b91547b768f5df7d8: Waiting for close lock at 1676171046129Running coprocessor pre-close hooks at 1676171046129Disabling compacts and flushes for region at 1676171046129Disabling writes for close at 1676171046129Writing region close event to WAL at 1676171046130 (+1 ms)Running coprocessor post-close hooks at 1676171046133 (+3 ms)Closed at 1676171046133 2023-02-12 03:04:06,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:06,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d4f87bec35c8b30b91547b768f5df7d8, regionState=CLOSED 2023-02-12 03:04:06,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676171046134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171046134"}]},"ts":"1676171046134"} 2023-02-12 03:04:06,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 03:04:06,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d4f87bec35c8b30b91547b768f5df7d8, server=jenkins-hbase6.apache.org,46415,1676171043422 in 159 msec 2023-02-12 03:04:06,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 03:04:06,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=d4f87bec35c8b30b91547b768f5df7d8, UNASSIGN in 165 msec 2023-02-12 03:04:06,139 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171046139"}]},"ts":"1676171046139"} 2023-02-12 03:04:06,140 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-12 03:04:06,142 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-12 03:04:06,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 177 msec 2023-02-12 03:04:06,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:06,272 INFO [Listener at localhost/34261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-12 03:04:06,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,276 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,277 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:06,281 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:06,283 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/recovered.edits] 2023-02-12 03:04:06,287 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/e8b4760dbfe7412dbc6cbf251ef4fcf4 2023-02-12 03:04:06,289 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/fb9e5aa39d7e46118c65fc22e5587f24 to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f1/fb9e5aa39d7e46118c65fc22e5587f24 2023-02-12 03:04:06,292 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/cd1c6cc5eced4f91a5f0d9d7d1e59b51 2023-02-12 03:04:06,293 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105 to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/f2/e91cb31e0aab4dcfa6824488d6528105 2023-02-12 03:04:06,296 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/recovered.edits/12.seqid to hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8/recovered.edits/12.seqid 2023-02-12 03:04:06,297 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/d4f87bec35c8b30b91547b768f5df7d8 2023-02-12 03:04:06,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 03:04:06,299 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,301 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-12 03:04:06,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-12 03:04:06,309 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,309 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-12 03:04:06,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171046309"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:06,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 03:04:06,310 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d4f87bec35c8b30b91547b768f5df7d8, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676171044494.d4f87bec35c8b30b91547b768f5df7d8.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 03:04:06,310 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-12 03:04:06,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171046310"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:06,312 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-12 03:04:06,314 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 03:04:06,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 41 msec 2023-02-12 03:04:06,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40275] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:06,379 INFO [Listener at localhost/34261] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-12 03:04:06,379 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:04:06,379 INFO [Listener at localhost/34261] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:04:06,380 DEBUG [Listener at localhost/34261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d52a58 to 127.0.0.1:63273 2023-02-12 03:04:06,380 DEBUG [Listener at localhost/34261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,380 DEBUG [Listener at localhost/34261] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:04:06,380 DEBUG [Listener at localhost/34261] util.JVMClusterUtil(257): Found active master hash=2018117339, stopped=false 2023-02-12 03:04:06,380 INFO [Listener at localhost/34261] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:06,382 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:06,382 INFO [Listener at localhost/34261] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:04:06,382 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:06,382 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:06,383 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:06,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:06,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:06,384 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:06,384 DEBUG [Listener at localhost/34261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77bd30ca to 127.0.0.1:63273 2023-02-12 03:04:06,384 DEBUG [Listener at localhost/34261] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,384 INFO [Listener at localhost/34261] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,46415,1676171043422' ***** 2023-02-12 03:04:06,384 INFO [Listener at localhost/34261] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:06,384 INFO [Listener at localhost/34261] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,39701,1676171043447' ***** 2023-02-12 03:04:06,384 INFO [Listener at localhost/34261] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:06,385 INFO [RS:0;jenkins-hbase6:46415] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:06,385 INFO [RS:1;jenkins-hbase6:39701] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:06,385 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:06,385 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:06,385 INFO [RS:1;jenkins-hbase6:39701] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:06,385 INFO [RS:0;jenkins-hbase6:46415] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:06,387 INFO [RS:1;jenkins-hbase6:39701] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(3304): Received CLOSE for 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:06,387 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:06,387 DEBUG [RS:1;jenkins-hbase6:39701] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x429246ea to 127.0.0.1:63273 2023-02-12 03:04:06,387 DEBUG [RS:0;jenkins-hbase6:46415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x659d02c5 to 127.0.0.1:63273 2023-02-12 03:04:06,387 DEBUG [RS:0;jenkins-hbase6:46415] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 4f654da9531c40e3cec43114dd518993, disabling compactions & flushes 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:06,387 DEBUG [RS:1;jenkins-hbase6:39701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:06,387 INFO [RS:0;jenkins-hbase6:46415] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:06,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:06,388 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:04:06,387 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,39701,1676171043447; all regions closed. 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:06,388 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. after waiting 0 ms 2023-02-12 03:04:06,388 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 4f654da9531c40e3cec43114dd518993=hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993.} 2023-02-12 03:04:06,388 DEBUG [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1505): Waiting on 1588230740, 4f654da9531c40e3cec43114dd518993 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:06,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:04:06,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 4f654da9531c40e3cec43114dd518993 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:04:06,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:04:06,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-12 03:04:06,395 DEBUG [RS:1;jenkins-hbase6:39701] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs 2023-02-12 03:04:06,395 INFO [RS:1;jenkins-hbase6:39701] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C39701%2C1676171043447:(num 1676171044747) 2023-02-12 03:04:06,395 DEBUG [RS:1;jenkins-hbase6:39701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,395 INFO [RS:1;jenkins-hbase6:39701] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:06,396 INFO [RS:1;jenkins-hbase6:39701] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:06,396 INFO [RS:1;jenkins-hbase6:39701] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:06,396 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:06,396 INFO [RS:1;jenkins-hbase6:39701] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:06,397 INFO [RS:1;jenkins-hbase6:39701] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:06,398 INFO [RS:1;jenkins-hbase6:39701] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:39701 2023-02-12 03:04:06,402 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:06,402 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:06,402 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:06,402 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,39701,1676171043447 2023-02-12 03:04:06,406 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5887d8d6 rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,407 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:06,407 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ece3ef8 rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,407 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,39701,1676171043447] 2023-02-12 03:04:06,407 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,39701,1676171043447; numProcessing=1 2023-02-12 03:04:06,409 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,39701,1676171043447 already deleted, retry=false 2023-02-12 03:04:06,409 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,39701,1676171043447 expired; onlineServers=1 2023-02-12 03:04:06,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/.tmp/info/85bdebe0f4d9483fbe26c5346af3ff53 2023-02-12 03:04:06,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/info/bce24dbb0e024a3f963e85ec3d4056fb 2023-02-12 03:04:06,423 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:06,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/.tmp/info/85bdebe0f4d9483fbe26c5346af3ff53 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/info/85bdebe0f4d9483fbe26c5346af3ff53 2023-02-12 03:04:06,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bce24dbb0e024a3f963e85ec3d4056fb 2023-02-12 03:04:06,428 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:06,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/info/85bdebe0f4d9483fbe26c5346af3ff53, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:04:06,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4f654da9531c40e3cec43114dd518993 in 46ms, sequenceid=6, compaction requested=false 2023-02-12 03:04:06,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/namespace/4f654da9531c40e3cec43114dd518993/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:04:06,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:06,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 4f654da9531c40e3cec43114dd518993: Waiting for close lock at 1676171046387Running coprocessor pre-close hooks at 1676171046387Disabling compacts and flushes for region at 1676171046387Disabling writes for close at 1676171046388 (+1 ms)Obtaining lock to block concurrent updates at 1676171046388Preparing flush snapshotting stores in 4f654da9531c40e3cec43114dd518993 at 1676171046388Finished memstore snapshotting hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171046388Flushing stores of hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. at 1676171046389 (+1 ms)Flushing 4f654da9531c40e3cec43114dd518993/info: creating writer at 1676171046389Flushing 4f654da9531c40e3cec43114dd518993/info: appending metadata at 1676171046393 (+4 ms)Flushing 4f654da9531c40e3cec43114dd518993/info: closing flushed file at 1676171046393Flushing 4f654da9531c40e3cec43114dd518993/info: reopening flushed file at 1676171046428 (+35 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4f654da9531c40e3cec43114dd518993 in 46ms, sequenceid=6, compaction requested=false at 1676171046434 (+6 ms)Writing region close event to WAL at 1676171046435 (+1 ms)Running coprocessor post-close hooks at 1676171046439 (+4 ms)Closed at 1676171046439 2023-02-12 03:04:06,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171044017.4f654da9531c40e3cec43114dd518993. 2023-02-12 03:04:06,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/rep_barrier/97e957db84ac4b27ab6ad6b77dd965e0 2023-02-12 03:04:06,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97e957db84ac4b27ab6ad6b77dd965e0 2023-02-12 03:04:06,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/table/935d91602ce7467fa3e5dc4668647b47 2023-02-12 03:04:06,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 935d91602ce7467fa3e5dc4668647b47 2023-02-12 03:04:06,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/info/bce24dbb0e024a3f963e85ec3d4056fb as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/info/bce24dbb0e024a3f963e85ec3d4056fb 2023-02-12 03:04:06,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bce24dbb0e024a3f963e85ec3d4056fb 2023-02-12 03:04:06,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/info/bce24dbb0e024a3f963e85ec3d4056fb, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 03:04:06,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/rep_barrier/97e957db84ac4b27ab6ad6b77dd965e0 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/rep_barrier/97e957db84ac4b27ab6ad6b77dd965e0 2023-02-12 03:04:06,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97e957db84ac4b27ab6ad6b77dd965e0 2023-02-12 03:04:06,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/rep_barrier/97e957db84ac4b27ab6ad6b77dd965e0, entries=1, sequenceid=21, filesize=5.1 K 2023-02-12 03:04:06,467 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/.tmp/table/935d91602ce7467fa3e5dc4668647b47 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/table/935d91602ce7467fa3e5dc4668647b47 2023-02-12 03:04:06,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 935d91602ce7467fa3e5dc4668647b47 2023-02-12 03:04:06,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/table/935d91602ce7467fa3e5dc4668647b47, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 03:04:06,472 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=21, compaction requested=false 2023-02-12 03:04:06,477 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 03:04:06,477 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:04:06,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:06,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171046388Running coprocessor pre-close hooks at 1676171046388Disabling compacts and flushes for region at 1676171046388Disabling writes for close at 1676171046388Obtaining lock to block concurrent updates at 1676171046388Preparing flush snapshotting stores in 1588230740 at 1676171046388Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676171046389 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676171046390 (+1 ms)Flushing 1588230740/info: creating writer at 1676171046390Flushing 1588230740/info: appending metadata at 1676171046394 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676171046394Flushing 1588230740/rep_barrier: creating writer at 1676171046430 (+36 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171046432 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171046432Flushing 1588230740/table: creating writer at 1676171046444 (+12 ms)Flushing 1588230740/table: appending metadata at 1676171046446 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676171046446Flushing 1588230740/info: reopening flushed file at 1676171046458 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171046463 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676171046467 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=21, compaction requested=false at 1676171046472 (+5 ms)Writing region close event to WAL at 1676171046474 (+2 ms)Running coprocessor post-close hooks at 1676171046477 (+3 ms)Closed at 1676171046478 (+1 ms) 2023-02-12 03:04:06,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:06,583 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:06,583 INFO [RS:1;jenkins-hbase6:39701] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,39701,1676171043447; zookeeper connection closed. 2023-02-12 03:04:06,583 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3677bc3b rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,583 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a775036] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a775036 2023-02-12 03:04:06,583 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:39701-0x10154e9965d0002, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:06,583 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4613f596 rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,588 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,46415,1676171043422; all regions closed. 2023-02-12 03:04:06,593 DEBUG [RS:0;jenkins-hbase6:46415] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs 2023-02-12 03:04:06,593 INFO [RS:0;jenkins-hbase6:46415] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46415%2C1676171043422.meta:.meta(num 1676171043964) 2023-02-12 03:04:06,596 DEBUG [RS:0;jenkins-hbase6:46415] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/oldWALs 2023-02-12 03:04:06,597 INFO [RS:0;jenkins-hbase6:46415] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C46415%2C1676171043422:(num 1676171044363) 2023-02-12 03:04:06,597 DEBUG [RS:0;jenkins-hbase6:46415] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,597 INFO [RS:0;jenkins-hbase6:46415] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:06,597 INFO [RS:0;jenkins-hbase6:46415] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:06,597 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:06,598 INFO [RS:0;jenkins-hbase6:46415] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46415 2023-02-12 03:04:06,600 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,46415,1676171043422 2023-02-12 03:04:06,600 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:06,600 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c5217d0 rejected from java.util.concurrent.ThreadPoolExecutor@186d9082[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,601 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,46415,1676171043422] 2023-02-12 03:04:06,601 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,46415,1676171043422; numProcessing=2 2023-02-12 03:04:06,602 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,46415,1676171043422 already deleted, retry=false 2023-02-12 03:04:06,602 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,46415,1676171043422 expired; onlineServers=0 2023-02-12 03:04:06,602 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,40275,1676171043372' ***** 2023-02-12 03:04:06,602 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:04:06,603 DEBUG [M:0;jenkins-hbase6:40275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c759d0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:06,603 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,40275,1676171043372 2023-02-12 03:04:06,603 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,40275,1676171043372; all regions closed. 2023-02-12 03:04:06,603 DEBUG [M:0;jenkins-hbase6:40275] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:06,603 DEBUG [M:0;jenkins-hbase6:40275] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:04:06,603 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:04:06,603 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171043610] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171043610,5,FailOnTimeoutGroup] 2023-02-12 03:04:06,603 DEBUG [M:0;jenkins-hbase6:40275] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:04:06,603 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171043611] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171043611,5,FailOnTimeoutGroup] 2023-02-12 03:04:06,604 INFO [M:0;jenkins-hbase6:40275] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:04:06,604 INFO [M:0;jenkins-hbase6:40275] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:04:06,605 INFO [M:0;jenkins-hbase6:40275] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:04:06,605 DEBUG [M:0;jenkins-hbase6:40275] master.HMaster(1502): Stopping service threads 2023-02-12 03:04:06,605 INFO [M:0;jenkins-hbase6:40275] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:04:06,605 ERROR [M:0;jenkins-hbase6:40275] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:04:06,605 INFO [M:0;jenkins-hbase6:40275] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:04:06,605 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:04:06,606 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:06,606 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:06,606 DEBUG [M:0;jenkins-hbase6:40275] zookeeper.ZKUtil(398): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:04:06,606 WARN [M:0;jenkins-hbase6:40275] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:04:06,606 INFO [M:0;jenkins-hbase6:40275] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:04:06,607 INFO [M:0;jenkins-hbase6:40275] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:04:06,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:06,607 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:04:06,607 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:06,607 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:06,607 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:04:06,607 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:06,607 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.63 KB heapSize=67.59 KB 2023-02-12 03:04:06,617 INFO [M:0;jenkins-hbase6:40275] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.63 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/318b5f1a5cfd46acb0960010a2600826 2023-02-12 03:04:06,621 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/318b5f1a5cfd46acb0960010a2600826 as hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/318b5f1a5cfd46acb0960010a2600826 2023-02-12 03:04:06,625 INFO [M:0;jenkins-hbase6:40275] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/0cb3a33d-e027-5fe3-0975-243c920f0f83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/318b5f1a5cfd46acb0960010a2600826, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 03:04:06,625 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegion(2947): Finished flush of dataSize ~56.63 KB/57985, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-12 03:04:06,626 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:06,626 DEBUG [M:0;jenkins-hbase6:40275] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171046607Disabling compacts and flushes for region at 1676171046607Disabling writes for close at 1676171046607Obtaining lock to block concurrent updates at 1676171046607Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171046607Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57985, getHeapSize=69200, getOffHeapSize=0, getCellsCount=145 at 1676171046608 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171046608Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171046608Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171046610 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171046610Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171046621 (+11 ms)Finished flush of dataSize ~56.63 KB/57985, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676171046625 (+4 ms)Writing region close event to WAL at 1676171046626 (+1 ms)Closed at 1676171046626 2023-02-12 03:04:06,628 INFO [M:0;jenkins-hbase6:40275] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:04:06,628 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:06,629 INFO [M:0;jenkins-hbase6:40275] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:40275 2023-02-12 03:04:06,630 DEBUG [M:0;jenkins-hbase6:40275] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,40275,1676171043372 already deleted, retry=false 2023-02-12 03:04:06,984 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:06,984 INFO [M:0;jenkins-hbase6:40275] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,40275,1676171043372; zookeeper connection closed. 2023-02-12 03:04:06,984 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37df5061 rejected from java.util.concurrent.ThreadPoolExecutor@33e0d242[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:06,985 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): master:40275-0x10154e9965d0000, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:06,985 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a4fac9d rejected from java.util.concurrent.ThreadPoolExecutor@33e0d242[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:07,084 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:07,084 INFO [RS:0;jenkins-hbase6:46415] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,46415,1676171043422; zookeeper connection closed. 2023-02-12 03:04:07,085 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@601837df rejected from java.util.concurrent.ThreadPoolExecutor@186d9082[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:07,085 DEBUG [Listener at localhost/34261-EventThread] zookeeper.ZKWatcher(600): regionserver:46415-0x10154e9965d0001, quorum=127.0.0.1:63273, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:07,085 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7022ba93] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7022ba93 2023-02-12 03:04:07,085 ERROR [Listener at localhost/34261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18e53416 rejected from java.util.concurrent.ThreadPoolExecutor@186d9082[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:07,085 INFO [Listener at localhost/34261] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:04:07,085 WARN [Listener at localhost/34261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:07,089 INFO [Listener at localhost/34261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:07,191 WARN [BP-1486719115-172.31.2.20-1676171042703 heartbeating to localhost/127.0.0.1:35969] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:07,193 WARN [BP-1486719115-172.31.2.20-1676171042703 heartbeating to localhost/127.0.0.1:35969] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1486719115-172.31.2.20-1676171042703 (Datanode Uuid b6d66171-2cad-4718-84f8-c3134a525561) service to localhost/127.0.0.1:35969 2023-02-12 03:04:07,195 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/dfs/data/data3/current/BP-1486719115-172.31.2.20-1676171042703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:07,195 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/dfs/data/data4/current/BP-1486719115-172.31.2.20-1676171042703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:07,197 WARN [Listener at localhost/34261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:07,203 INFO [Listener at localhost/34261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:07,309 WARN [BP-1486719115-172.31.2.20-1676171042703 heartbeating to localhost/127.0.0.1:35969] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:07,309 WARN [BP-1486719115-172.31.2.20-1676171042703 heartbeating to localhost/127.0.0.1:35969] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1486719115-172.31.2.20-1676171042703 (Datanode Uuid a03a978c-4cdc-45d3-ac18-9275b1e22d31) service to localhost/127.0.0.1:35969 2023-02-12 03:04:07,309 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/dfs/data/data1/current/BP-1486719115-172.31.2.20-1676171042703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:07,310 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/cluster_e870d3af-c579-afce-521d-18f7f3816439/dfs/data/data2/current/BP-1486719115-172.31.2.20-1676171042703] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:07,319 INFO [Listener at localhost/34261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:07,433 INFO [Listener at localhost/34261] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:04:07,453 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:04:07,465 INFO [Listener at localhost/34261] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 255) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35969 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35969 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34261 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:35969 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:35969 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,40275,1676171043372)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:35969 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=566 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 258) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5282 (was 5342) 2023-02-12 03:04:07,477 INFO [Listener at localhost/34261] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=566, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=167, AvailableMemoryMB=5282 2023-02-12 03:04:07,487 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.log.dir so I do NOT create it in target/test-data/2650bb57-fa77-9f69-e946-92961a00a528 2023-02-12 03:04:07,487 WARN [Listener at localhost/34261] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 03:04:07,487 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.tmp.dir so I do NOT create it in target/test-data/2650bb57-fa77-9f69-e946-92961a00a528 2023-02-12 03:04:07,487 WARN [Listener at localhost/34261] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5ceb292-e92c-f0c8-3d69-ec69af43b916/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 03:04:07,487 DEBUG [Listener at localhost/34261] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528 2023-02-12 03:04:07,487 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 03:04:07,487 INFO [Listener at localhost/34261] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc, deleteOnExit=true 2023-02-12 03:04:07,487 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/test.cache.data in system properties and HBase conf 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:04:07,488 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:04:07,489 DEBUG [Listener at localhost/34261] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:04:07,489 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:04:07,490 INFO [Listener at localhost/34261] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:04:07,494 WARN [Listener at localhost/34261] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:04:07,494 WARN [Listener at localhost/34261] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:04:07,546 WARN [Listener at localhost/34261] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:07,548 INFO [Listener at localhost/34261] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:07,552 INFO [Listener at localhost/34261] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/java.io.tmpdir/Jetty_localhost_41095_hdfs____a1hfmh/webapp 2023-02-12 03:04:07,644 INFO [Listener at localhost/34261] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41095 2023-02-12 03:04:07,648 WARN [Listener at localhost/34261] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:04:07,648 WARN [Listener at localhost/34261] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:04:07,688 WARN [Listener at localhost/34227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:07,705 WARN [Listener at localhost/34227] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:04:07,707 WARN [Listener at localhost/34227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:07,708 INFO [Listener at localhost/34227] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:07,714 INFO [Listener at localhost/34227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/java.io.tmpdir/Jetty_localhost_45457_datanode____.54b9ic/webapp 2023-02-12 03:04:07,806 INFO [Listener at localhost/34227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45457 2023-02-12 03:04:07,814 WARN [Listener at localhost/34785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:07,832 WARN [Listener at localhost/34785] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:04:07,834 WARN [Listener at localhost/34785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:04:07,836 INFO [Listener at localhost/34785] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:04:07,846 INFO [Listener at localhost/34785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/java.io.tmpdir/Jetty_localhost_42471_datanode____wloerb/webapp 2023-02-12 03:04:07,935 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c4c552fc8bf5271: Processing first storage report for DS-cfbef380-d0d1-4b65-8bff-e97768b196af from datanode c9699414-df1a-4291-b983-03a7eb31feae 2023-02-12 03:04:07,935 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c4c552fc8bf5271: from storage DS-cfbef380-d0d1-4b65-8bff-e97768b196af node DatanodeRegistration(127.0.0.1:45599, datanodeUuid=c9699414-df1a-4291-b983-03a7eb31feae, infoPort=44699, infoSecurePort=0, ipcPort=34785, storageInfo=lv=-57;cid=testClusterID;nsid=1746139169;c=1676171047497), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:07,935 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c4c552fc8bf5271: Processing first storage report for DS-3a2c9d22-75cc-4b69-a698-b7c8bf4b2ca8 from datanode c9699414-df1a-4291-b983-03a7eb31feae 2023-02-12 03:04:07,935 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c4c552fc8bf5271: from storage DS-3a2c9d22-75cc-4b69-a698-b7c8bf4b2ca8 node DatanodeRegistration(127.0.0.1:45599, datanodeUuid=c9699414-df1a-4291-b983-03a7eb31feae, infoPort=44699, infoSecurePort=0, ipcPort=34785, storageInfo=lv=-57;cid=testClusterID;nsid=1746139169;c=1676171047497), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:07,954 INFO [Listener at localhost/34785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42471 2023-02-12 03:04:07,962 WARN [Listener at localhost/41217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:04:08,063 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x381d53f9c1428afa: Processing first storage report for DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81 from datanode e6bbeac9-81fe-4411-9221-b89219c64b69 2023-02-12 03:04:08,064 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x381d53f9c1428afa: from storage DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81 node DatanodeRegistration(127.0.0.1:45949, datanodeUuid=e6bbeac9-81fe-4411-9221-b89219c64b69, infoPort=37021, infoSecurePort=0, ipcPort=41217, storageInfo=lv=-57;cid=testClusterID;nsid=1746139169;c=1676171047497), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:08,064 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x381d53f9c1428afa: Processing first storage report for DS-e8e988c3-f607-4679-ab5d-01e368752d26 from datanode e6bbeac9-81fe-4411-9221-b89219c64b69 2023-02-12 03:04:08,064 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x381d53f9c1428afa: from storage DS-e8e988c3-f607-4679-ab5d-01e368752d26 node DatanodeRegistration(127.0.0.1:45949, datanodeUuid=e6bbeac9-81fe-4411-9221-b89219c64b69, infoPort=37021, infoSecurePort=0, ipcPort=41217, storageInfo=lv=-57;cid=testClusterID;nsid=1746139169;c=1676171047497), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:04:08,069 DEBUG [Listener at localhost/41217] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528 2023-02-12 03:04:08,072 INFO [Listener at localhost/41217] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/zookeeper_0, clientPort=58898, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:04:08,073 INFO [Listener at localhost/41217] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58898 2023-02-12 03:04:08,074 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,075 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,089 INFO [Listener at localhost/41217] util.FSUtils(479): Created version file at hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61 with version=8 2023-02-12 03:04:08,089 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,091 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,092 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/hbase-staging 2023-02-12 03:04:08,094 INFO [Listener at localhost/41217] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:08,094 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,095 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,095 INFO [Listener at localhost/41217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:08,095 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,095 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:08,095 INFO [Listener at localhost/41217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:08,096 INFO [Listener at localhost/41217] ipc.NettyRpcServer(120): Bind to /172.31.2.20:46173 2023-02-12 03:04:08,096 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,097 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,098 INFO [Listener at localhost/41217] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46173 connecting to ZooKeeper ensemble=127.0.0.1:58898 2023-02-12 03:04:08,106 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:461730x0, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:08,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46173-0x10154e9a8cd0000 connected 2023-02-12 03:04:08,130 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:08,130 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:08,131 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:08,134 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46173 2023-02-12 03:04:08,134 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46173 2023-02-12 03:04:08,134 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46173 2023-02-12 03:04:08,137 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46173 2023-02-12 03:04:08,138 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46173 2023-02-12 03:04:08,138 INFO [Listener at localhost/41217] master.HMaster(439): hbase.rootdir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61, hbase.cluster.distributed=false 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:08,153 INFO [Listener at localhost/41217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:08,154 INFO [Listener at localhost/41217] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44303 2023-02-12 03:04:08,154 INFO [Listener at localhost/41217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:04:08,155 DEBUG [Listener at localhost/41217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:08,155 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,156 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,157 INFO [Listener at localhost/41217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44303 connecting to ZooKeeper ensemble=127.0.0.1:58898 2023-02-12 03:04:08,160 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:443030x0, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:08,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44303-0x10154e9a8cd0001 connected 2023-02-12 03:04:08,162 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:08,163 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:08,163 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:08,164 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44303 2023-02-12 03:04:08,166 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44303 2023-02-12 03:04:08,166 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44303 2023-02-12 03:04:08,169 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44303 2023-02-12 03:04:08,170 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44303 2023-02-12 03:04:08,181 INFO [Listener at localhost/41217] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-02-12 03:04:08,181 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,181 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,181 INFO [Listener at localhost/41217] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:04:08,182 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:04:08,182 INFO [Listener at localhost/41217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:04:08,182 INFO [Listener at localhost/41217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:04:08,183 INFO [Listener at localhost/41217] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44047 2023-02-12 03:04:08,183 INFO [Listener at localhost/41217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:04:08,186 DEBUG [Listener at localhost/41217] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:08,187 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,188 INFO [Listener at localhost/41217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,188 INFO [Listener at localhost/41217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44047 connecting to ZooKeeper ensemble=127.0.0.1:58898 2023-02-12 03:04:08,191 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:440470x0, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:04:08,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44047-0x10154e9a8cd0002 connected 2023-02-12 03:04:08,192 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:08,193 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:08,193 DEBUG [Listener at localhost/41217] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:04:08,194 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44047 2023-02-12 03:04:08,195 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44047 2023-02-12 03:04:08,197 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44047 2023-02-12 03:04:08,197 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44047 2023-02-12 03:04:08,198 DEBUG [Listener at localhost/41217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44047 2023-02-12 03:04:08,201 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,202 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:04:08,203 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,204 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:08,204 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:08,204 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:08,206 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,206 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:04:08,208 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,46173,1676171048094 from backup master directory 2023-02-12 03:04:08,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:04:08,209 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,209 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:04:08,209 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:08,209 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,221 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/hbase.id with ID: 3a8d2c48-8de4-4812-b402-7d16301b69bd 2023-02-12 03:04:08,229 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:04:08,232 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,243 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x17e519e3 to 127.0.0.1:58898 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:08,247 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f811bfe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:08,247 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:08,247 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:04:08,247 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:08,249 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store-tmp 2023-02-12 03:04:08,256 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:08,256 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:04:08,256 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:08,257 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:08,257 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:04:08,257 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:08,257 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:08,257 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171048256Disabling compacts and flushes for region at 1676171048256Disabling writes for close at 1676171048257 (+1 ms)Writing region close event to WAL at 1676171048257Closed at 1676171048257 2023-02-12 03:04:08,257 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/WALs/jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,259 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C46173%2C1676171048094, suffix=, logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/WALs/jenkins-hbase6.apache.org,46173,1676171048094, archiveDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/oldWALs, maxLogs=10 2023-02-12 03:04:08,271 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK] 2023-02-12 03:04:08,272 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK] 2023-02-12 03:04:08,273 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/WALs/jenkins-hbase6.apache.org,46173,1676171048094/jenkins-hbase6.apache.org%2C46173%2C1676171048094.1676171048259 2023-02-12 03:04:08,274 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK], DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK]] 2023-02-12 03:04:08,274 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:08,274 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:08,274 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,274 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,277 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,278 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:04:08,279 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:04:08,279 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,280 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,280 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,282 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:04:08,283 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:08,283 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61268461, jitterRate=-0.08702878654003143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:04:08,284 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676171048274Initializing all the Stores at 1676171048275 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171048275Cleaning up temporary data from old regions at 1676171048280 (+5 ms)Cleaning up detritus from prior splits at 1676171048281 (+1 ms)Region opened successfully at 1676171048284 (+3 ms) 2023-02-12 03:04:08,284 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:04:08,285 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:04:08,285 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:04:08,285 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:04:08,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 03:04:08,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 03:04:08,286 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:04:08,287 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:04:08,287 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:04:08,297 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:04:08,297 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:04:08,298 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:04:08,298 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:04:08,298 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:04:08,301 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:04:08,302 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:04:08,303 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:04:08,304 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:08,304 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:08,304 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,304 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:08,304 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase6.apache.org,46173,1676171048094, sessionid=0x10154e9a8cd0000, setting cluster-up flag (Was=false) 2023-02-12 03:04:08,310 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,315 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:04:08,316 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,319 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,323 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:04:08,324 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:08,324 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/.tmp 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:08,326 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676171078329 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:04:08,329 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:08,329 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:04:08,329 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,330 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:04:08,330 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:04:08,331 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171048331,5,FailOnTimeoutGroup] 2023-02-12 03:04:08,331 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:08,331 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171048331,5,FailOnTimeoutGroup] 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,331 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,338 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:08,338 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:08,339 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61 2023-02-12 03:04:08,344 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:08,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:04:08,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/info 2023-02-12 03:04:08,346 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:04:08,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:04:08,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:08,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:04:08,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:04:08,348 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/table 2023-02-12 03:04:08,349 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:04:08,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,349 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740 2023-02-12 03:04:08,350 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740 2023-02-12 03:04:08,351 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:04:08,352 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:04:08,353 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:08,353 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74194538, jitterRate=0.1055847704410553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:04:08,353 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676171048344Initializing all the Stores at 1676171048344Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171048344Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171048344Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171048344Cleaning up temporary data from old regions at 1676171048350 (+6 ms)Cleaning up detritus from prior splits at 1676171048350Region opened successfully at 1676171048353 (+3 ms) 2023-02-12 03:04:08,353 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:04:08,354 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:04:08,354 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:04:08,354 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:04:08,354 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:04:08,354 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:08,354 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171048353Disabling compacts and flushes for region at 1676171048353Disabling writes for close at 1676171048354 (+1 ms)Writing region close event to WAL at 1676171048354Closed at 1676171048354 2023-02-12 03:04:08,355 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:04:08,355 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:04:08,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:04:08,356 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:04:08,357 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:04:08,402 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(952): ClusterId : 3a8d2c48-8de4-4812-b402-7d16301b69bd 2023-02-12 03:04:08,402 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(952): ClusterId : 3a8d2c48-8de4-4812-b402-7d16301b69bd 2023-02-12 03:04:08,402 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:04:08,402 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:04:08,404 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:04:08,404 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:04:08,404 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:04:08,404 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:04:08,407 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:04:08,408 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:04:08,408 DEBUG [RS:1;jenkins-hbase6:44047] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc9723b to 127.0.0.1:58898 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:08,409 DEBUG [RS:0;jenkins-hbase6:44303] zookeeper.ReadOnlyZKClient(139): Connect 0x4f0c1ee7 to 127.0.0.1:58898 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:08,412 DEBUG [RS:1;jenkins-hbase6:44047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720e93d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:08,412 DEBUG [RS:1;jenkins-hbase6:44047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7631194b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:08,412 DEBUG [RS:0;jenkins-hbase6:44303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41cbf976, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:08,412 DEBUG [RS:0;jenkins-hbase6:44303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45f47597, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:08,420 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:44047 2023-02-12 03:04:08,420 INFO [RS:1;jenkins-hbase6:44047] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:04:08,421 INFO [RS:1;jenkins-hbase6:44047] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:04:08,421 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:04:08,421 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,46173,1676171048094 with isa=jenkins-hbase6.apache.org/172.31.2.20:44047, startcode=1676171048181 2023-02-12 03:04:08,421 DEBUG [RS:1;jenkins-hbase6:44047] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:04:08,423 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:34405, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:04:08,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,425 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61 2023-02-12 03:04:08,425 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34227 2023-02-12 03:04:08,425 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:04:08,425 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:44303 2023-02-12 03:04:08,425 INFO [RS:0;jenkins-hbase6:44303] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:04:08,425 INFO [RS:0;jenkins-hbase6:44303] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:04:08,425 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:04:08,426 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:08,427 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase6.apache.org,46173,1676171048094 with isa=jenkins-hbase6.apache.org/172.31.2.20:44303, startcode=1676171048153 2023-02-12 03:04:08,427 DEBUG [RS:1;jenkins-hbase6:44047] zookeeper.ZKUtil(162): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,427 DEBUG [RS:0;jenkins-hbase6:44303] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:04:08,427 WARN [RS:1;jenkins-hbase6:44047] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:08,428 INFO [RS:1;jenkins-hbase6:44047] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:08,428 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,428 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44047,1676171048181] 2023-02-12 03:04:08,432 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:38041, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:04:08,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,433 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61 2023-02-12 03:04:08,433 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34227 2023-02-12 03:04:08,433 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:04:08,433 DEBUG [RS:1;jenkins-hbase6:44047] zookeeper.ZKUtil(162): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,438 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:08,438 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:08,438 DEBUG [RS:0;jenkins-hbase6:44303] zookeeper.ZKUtil(162): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,438 WARN [RS:0;jenkins-hbase6:44303] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:04:08,438 INFO [RS:0;jenkins-hbase6:44303] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:08,438 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:04:08,438 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44303,1676171048153] 2023-02-12 03:04:08,438 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,439 INFO [RS:1;jenkins-hbase6:44047] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:04:08,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,440 INFO [RS:1;jenkins-hbase6:44047] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:04:08,441 INFO [RS:1;jenkins-hbase6:44047] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:04:08,441 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,442 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:04:08,445 DEBUG [RS:0;jenkins-hbase6:44303] zookeeper.ZKUtil(162): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,445 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:0;jenkins-hbase6:44303] zookeeper.ZKUtil(162): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,446 DEBUG [RS:1;jenkins-hbase6:44047] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,447 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,447 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:04:08,447 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,447 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,447 INFO [RS:0;jenkins-hbase6:44303] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:04:08,448 INFO [RS:0;jenkins-hbase6:44303] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:04:08,449 INFO [RS:0;jenkins-hbase6:44303] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:04:08,449 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,449 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:04:08,450 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,451 DEBUG [RS:0;jenkins-hbase6:44303] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:04:08,454 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,454 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,454 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,462 INFO [RS:1;jenkins-hbase6:44047] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:04:08,462 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44047,1676171048181-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,465 INFO [RS:0;jenkins-hbase6:44303] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:04:08,465 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44303,1676171048153-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,474 INFO [RS:1;jenkins-hbase6:44047] regionserver.Replication(203): jenkins-hbase6.apache.org,44047,1676171048181 started 2023-02-12 03:04:08,474 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44047,1676171048181, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44047, sessionid=0x10154e9a8cd0002 2023-02-12 03:04:08,474 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:04:08,474 DEBUG [RS:1;jenkins-hbase6:44047] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,474 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44047,1676171048181' 2023-02-12 03:04:08,474 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44047,1676171048181' 2023-02-12 03:04:08,475 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:08,476 DEBUG [RS:1;jenkins-hbase6:44047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:08,476 DEBUG [RS:1;jenkins-hbase6:44047] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:04:08,476 INFO [RS:1;jenkins-hbase6:44047] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:04:08,476 INFO [RS:1;jenkins-hbase6:44047] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:04:08,477 INFO [RS:0;jenkins-hbase6:44303] regionserver.Replication(203): jenkins-hbase6.apache.org,44303,1676171048153 started 2023-02-12 03:04:08,477 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1638): Serving as jenkins-hbase6.apache.org,44303,1676171048153, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44303, sessionid=0x10154e9a8cd0001 2023-02-12 03:04:08,477 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:04:08,477 DEBUG [RS:0;jenkins-hbase6:44303] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,477 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44303,1676171048153' 2023-02-12 03:04:08,477 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:08,477 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44303,1676171048153' 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:08,478 DEBUG [RS:0;jenkins-hbase6:44303] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:04:08,478 INFO [RS:0;jenkins-hbase6:44303] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:04:08,478 INFO [RS:0;jenkins-hbase6:44303] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:04:08,508 DEBUG [jenkins-hbase6:46173] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 03:04:08,508 DEBUG [jenkins-hbase6:46173] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:08,509 DEBUG [jenkins-hbase6:46173] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:08,509 DEBUG [jenkins-hbase6:46173] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:08,509 DEBUG [jenkins-hbase6:46173] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:08,509 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44303,1676171048153, state=OPENING 2023-02-12 03:04:08,511 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:04:08,512 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:08,512 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:04:08,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44303,1676171048153}] 2023-02-12 03:04:08,667 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:08,667 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:04:08,669 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51396, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:04:08,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:04:08,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:04:08,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44303%2C1676171048153.meta, suffix=.meta, logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44303,1676171048153, archiveDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs, maxLogs=32 2023-02-12 03:04:08,689 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK] 2023-02-12 03:04:08,689 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK] 2023-02-12 03:04:08,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44303,1676171048153/jenkins-hbase6.apache.org%2C44303%2C1676171048153.meta.1676171048674.meta 2023-02-12 03:04:08,691 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK], DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK]] 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:04:08,692 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:04:08,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:04:08,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:04:08,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/info 2023-02-12 03:04:08,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/info 2023-02-12 03:04:08,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:04:08,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:04:08,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:08,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:04:08,696 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:04:08,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,696 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:04:08,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/table 2023-02-12 03:04:08,697 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/table 2023-02-12 03:04:08,697 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:04:08,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:08,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740 2023-02-12 03:04:08,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740 2023-02-12 03:04:08,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:04:08,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:04:08,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74577402, jitterRate=0.11128988862037659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:04:08,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676171048692Writing region info on filesystem at 1676171048692Initializing all the Stores at 1676171048693 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171048693Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171048693Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171048693Cleaning up temporary data from old regions at 1676171048699 (+6 ms)Cleaning up detritus from prior splits at 1676171048700 (+1 ms)Running coprocessor post-open hooks at 1676171048701 (+1 ms)Region opened successfully at 1676171048701 2023-02-12 03:04:08,702 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676171048667 2023-02-12 03:04:08,706 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:04:08,706 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:04:08,707 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44303,1676171048153, state=OPEN 2023-02-12 03:04:08,708 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:04:08,708 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:04:08,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:04:08,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44303,1676171048153 in 196 msec 2023-02-12 03:04:08,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:04:08,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-12 03:04:08,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 386 msec 2023-02-12 03:04:08,712 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676171048203, completionTime=-1 2023-02-12 03:04:08,712 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 03:04:08,712 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:04:08,715 DEBUG [hconnection-0x1e4702e9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:08,717 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:08,718 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 03:04:08,718 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676171108718 2023-02-12 03:04:08,718 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676171168718 2023-02-12 03:04:08,718 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46173,1676171048094-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46173,1676171048094-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46173,1676171048094-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:46173, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:04:08,724 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:08,725 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:04:08,726 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:04:08,727 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:04:08,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:04:08,729 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:08,729 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede empty. 2023-02-12 03:04:08,730 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:08,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:04:08,741 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:08,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 070d6b0575157bb4723e52f837a0fede, NAME => 'hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 070d6b0575157bb4723e52f837a0fede, disabling compactions & flushes 2023-02-12 03:04:08,748 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. after waiting 0 ms 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:08,748 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:08,748 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 070d6b0575157bb4723e52f837a0fede: Waiting for close lock at 1676171048748Disabling compacts and flushes for region at 1676171048748Disabling writes for close at 1676171048748Writing region close event to WAL at 1676171048748Closed at 1676171048748 2023-02-12 03:04:08,750 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:04:08,751 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171048751"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171048751"}]},"ts":"1676171048751"} 2023-02-12 03:04:08,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:04:08,753 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:04:08,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171048753"}]},"ts":"1676171048753"} 2023-02-12 03:04:08,754 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:04:08,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:08,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:08,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:08,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:08,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=070d6b0575157bb4723e52f837a0fede, ASSIGN}] 2023-02-12 03:04:08,761 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=070d6b0575157bb4723e52f837a0fede, ASSIGN 2023-02-12 03:04:08,761 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=070d6b0575157bb4723e52f837a0fede, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44047,1676171048181; forceNewPlan=false, retain=false 2023-02-12 03:04:08,911 INFO [jenkins-hbase6:46173] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:04:08,912 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=070d6b0575157bb4723e52f837a0fede, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:08,912 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171048912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171048912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171048912"}]},"ts":"1676171048912"} 2023-02-12 03:04:08,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 070d6b0575157bb4723e52f837a0fede, server=jenkins-hbase6.apache.org,44047,1676171048181}] 2023-02-12 03:04:09,066 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:09,066 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:04:09,068 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:04:09,071 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:09,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44047%2C1676171048181, suffix=, logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44047,1676171048181, archiveDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs, maxLogs=32 2023-02-12 03:04:09,086 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK] 2023-02-12 03:04:09,086 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK] 2023-02-12 03:04:09,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44047,1676171048181/jenkins-hbase6.apache.org%2C44047%2C1676171048181.1676171049072 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK], DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK]] 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 070d6b0575157bb4723e52f837a0fede, NAME => 'hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,089 INFO [StoreOpener-070d6b0575157bb4723e52f837a0fede-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,090 DEBUG [StoreOpener-070d6b0575157bb4723e52f837a0fede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/info 2023-02-12 03:04:09,090 DEBUG [StoreOpener-070d6b0575157bb4723e52f837a0fede-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/info 2023-02-12 03:04:09,091 INFO [StoreOpener-070d6b0575157bb4723e52f837a0fede-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070d6b0575157bb4723e52f837a0fede columnFamilyName info 2023-02-12 03:04:09,091 INFO [StoreOpener-070d6b0575157bb4723e52f837a0fede-1] regionserver.HStore(310): Store=070d6b0575157bb4723e52f837a0fede/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:09,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:09,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:09,096 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened 070d6b0575157bb4723e52f837a0fede; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67346245, jitterRate=0.0035372525453567505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:04:09,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for 070d6b0575157bb4723e52f837a0fede: Running coprocessor pre-open hook at 1676171049088Writing region info on filesystem at 1676171049088Initializing all the Stores at 1676171049089 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676171049089Cleaning up temporary data from old regions at 1676171049093 (+4 ms)Cleaning up detritus from prior splits at 1676171049093Running coprocessor post-open hooks at 1676171049096 (+3 ms)Region opened successfully at 1676171049096 2023-02-12 03:04:09,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede., pid=6, masterSystemTime=1676171049066 2023-02-12 03:04:09,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:09,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:09,102 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=070d6b0575157bb4723e52f837a0fede, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:09,102 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676171049102"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171049102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171049102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171049102"}]},"ts":"1676171049102"} 2023-02-12 03:04:09,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:04:09,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 070d6b0575157bb4723e52f837a0fede, server=jenkins-hbase6.apache.org,44047,1676171048181 in 191 msec 2023-02-12 03:04:09,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:04:09,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=070d6b0575157bb4723e52f837a0fede, ASSIGN in 347 msec 2023-02-12 03:04:09,107 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:04:09,108 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171049107"}]},"ts":"1676171049107"} 2023-02-12 03:04:09,109 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:04:09,112 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:04:09,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-12 03:04:09,126 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:04:09,127 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:09,127 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:09,129 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:09,131 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:09,132 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:04:09,138 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:09,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 03:04:09,143 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:04:09,149 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:04:09,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 03:04:09,157 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:04:09,160 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.951sec 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46173,1676171048094-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:04:09,160 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,46173,1676171048094-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:04:09,162 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:04:09,203 DEBUG [Listener at localhost/41217] zookeeper.ReadOnlyZKClient(139): Connect 0x07e4b6d0 to 127.0.0.1:58898 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:09,205 DEBUG [Listener at localhost/41217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e1814c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:09,207 DEBUG [hconnection-0x3862ddd2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:09,208 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:09,210 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:09,210 DEBUG [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 03:04:09,212 DEBUG [Listener at localhost/41217] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:04:09,214 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59546, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:04:09,214 INFO [Listener at localhost/41217] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 03:04:09,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-12 03:04:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:04:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.2.20:59546 deadline: 1676171109214, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 03:04:09,215 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 03:04:09,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.HMaster$4(2102): Client=jenkins//172.31.2.20 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:04:09,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 03:04:09,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:04:09,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(697): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 03:04:09,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:04:09,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:09,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,223 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 empty. 2023-02-12 03:04:09,223 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,223 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 03:04:09,231 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 03:04:09,232 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e00c8e3443cbdaa404857f26d2cd6552, NAME => 'testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp 2023-02-12 03:04:09,237 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:09,237 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e00c8e3443cbdaa404857f26d2cd6552, disabling compactions & flushes 2023-02-12 03:04:09,237 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,237 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,237 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. after waiting 0 ms 2023-02-12 03:04:09,237 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,238 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,238 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e00c8e3443cbdaa404857f26d2cd6552: Waiting for close lock at 1676171049237Disabling compacts and flushes for region at 1676171049237Disabling writes for close at 1676171049237Writing region close event to WAL at 1676171049238 (+1 ms)Closed at 1676171049238 2023-02-12 03:04:09,239 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:04:09,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676171049240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171049240"}]},"ts":"1676171049240"} 2023-02-12 03:04:09,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:04:09,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:04:09,242 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171049242"}]},"ts":"1676171049242"} 2023-02-12 03:04:09,243 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 03:04:09,247 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-02-12 03:04:09,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 03:04:09,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 03:04:09,248 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 03:04:09,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, ASSIGN}] 2023-02-12 03:04:09,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, ASSIGN 2023-02-12 03:04:09,252 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44303,1676171048153; forceNewPlan=false, retain=false 2023-02-12 03:04:09,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:09,402 INFO [jenkins-hbase6:46173] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 03:04:09,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e00c8e3443cbdaa404857f26d2cd6552, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676171049402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171049402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171049402"}]},"ts":"1676171049402"} 2023-02-12 03:04:09,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e00c8e3443cbdaa404857f26d2cd6552, server=jenkins-hbase6.apache.org,44303,1676171048153}] 2023-02-12 03:04:09,480 INFO [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44303%2C1676171048153, suffix=, logDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44303,1676171048153, archiveDir=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs, maxLogs=32 2023-02-12 03:04:09,484 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 03:04:09,496 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK] 2023-02-12 03:04:09,496 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK] 2023-02-12 03:04:09,498 INFO [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/WALs/jenkins-hbase6.apache.org,44303,1676171048153/jenkins-hbase6.apache.org%2C44303%2C1676171048153.1676171049480 2023-02-12 03:04:09,499 DEBUG [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45949,DS-cb959d9b-bf08-4a0c-956b-b6a47d68ab81,DISK], DatanodeInfoWithStorage[127.0.0.1:45599,DS-cfbef380-d0d1-4b65-8bff-e97768b196af,DISK]] 2023-02-12 03:04:09,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:09,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e00c8e3443cbdaa404857f26d2cd6552, NAME => 'testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:04:09,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:09,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7890): checking encryption for e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7893): checking classloading for e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,562 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,563 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1 2023-02-12 03:04:09,563 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1 2023-02-12 03:04:09,564 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00c8e3443cbdaa404857f26d2cd6552 columnFamilyName f1 2023-02-12 03:04:09,564 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(310): Store=e00c8e3443cbdaa404857f26d2cd6552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:09,564 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,565 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2 2023-02-12 03:04:09,566 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2 2023-02-12 03:04:09,566 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00c8e3443cbdaa404857f26d2cd6552 columnFamilyName f2 2023-02-12 03:04:09,566 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(310): Store=e00c8e3443cbdaa404857f26d2cd6552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:09,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:04:09,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1054): writing seq id for e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:09,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:04:09,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1071): Opened e00c8e3443cbdaa404857f26d2cd6552; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67009927, jitterRate=-0.0014742761850357056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:04:09,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(964): Region open journal for e00c8e3443cbdaa404857f26d2cd6552: Running coprocessor pre-open hook at 1676171049561Writing region info on filesystem at 1676171049561Initializing all the Stores at 1676171049561Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171049561Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171049562 (+1 ms)Cleaning up temporary data from old regions at 1676171049569 (+7 ms)Cleaning up detritus from prior splits at 1676171049569Running coprocessor post-open hooks at 1676171049574 (+5 ms)Region opened successfully at 1676171049574 2023-02-12 03:04:09,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552., pid=12, masterSystemTime=1676171049556 2023-02-12 03:04:09,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,579 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e00c8e3443cbdaa404857f26d2cd6552, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,579 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676171049579"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676171049579"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676171049579"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676171049579"}]},"ts":"1676171049579"} 2023-02-12 03:04:09,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 03:04:09,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e00c8e3443cbdaa404857f26d2cd6552, server=jenkins-hbase6.apache.org,44303,1676171048153 in 177 msec 2023-02-12 03:04:09,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 03:04:09,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, ASSIGN in 336 msec 2023-02-12 03:04:09,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:04:09,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171049586"}]},"ts":"1676171049586"} 2023-02-12 03:04:09,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 03:04:09,590 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:04:09,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 372 msec 2023-02-12 03:04:09,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 03:04:09,827 INFO [Listener at localhost/41217] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 03:04:09,827 DEBUG [Listener at localhost/41217] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 03:04:09,827 INFO [Listener at localhost/41217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:09,829 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 03:04:09,829 INFO [Listener at localhost/41217] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:04:09,829 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 03:04:09,829 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 03:04:09,856 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,940 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 03:04:09,940 INFO [Listener at localhost/41217] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 03:04:09,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1580): Client=jenkins//172.31.2.20 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:04:09,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676171049942 (current time:1676171049942). 2023-02-12 03:04:09,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:04:09,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] zookeeper.ReadOnlyZKClient(139): Connect 0x624edb1e to 127.0.0.1:58898 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:04:09,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d863487, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:04:09,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:04:09,947 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51432, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:04:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x624edb1e to 127.0.0.1:58898 2023-02-12 03:04:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:09,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:04:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:04:09,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:04:09,951 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:04:09,952 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676171649952 2023-02-12 03:04:09,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 03:04:09,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 03:04:09,953 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:09,954 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:04:09,954 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 03:04:09,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:04:09,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-12 03:04:09,955 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:04:09,956 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676171649956 2023-02-12 03:04:09,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-12 03:04:09,966 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-12 03:04:09,966 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:09,967 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-12 03:04:09,967 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 03:04:09,968 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:09,968 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:09,973 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:09,973 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:09,973 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:09,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:09,974 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,974 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 03:04:09,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 03:04:09,975 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 03:04:09,975 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:09,976 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:09,976 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 03:04:09,976 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 03:04:09,976 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:04:09,976 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44303,1676171048153' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 03:04:09,979 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 03:04:09,979 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 03:04:09,979 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44047,1676171048181' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 03:04:09,980 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,980 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:09,980 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,980 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,980 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:09,981 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:09,981 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:09,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:09,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44303,1676171048153' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-12 03:04:09,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6908070b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:09,982 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 03:04:09,982 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,983 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,983 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 03:04:09,984 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:09,984 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:04:09,984 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,44047,1676171048181' in zk 2023-02-12 03:04:09,984 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:09,984 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. started... 2023-02-12 03:04:09,984 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e00c8e3443cbdaa404857f26d2cd6552 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 03:04:09,985 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:09,985 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:09,985 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 03:04:09,998 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f1/921745e89d3547cfa068debdce6a756c 2023-02-12 03:04:10,021 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f2/d324b66f8ab44230bbf7c8c65f7b3c30 2023-02-12 03:04:10,025 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f1/921745e89d3547cfa068debdce6a756c as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c 2023-02-12 03:04:10,028 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:10,029 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f2/d324b66f8ab44230bbf7c8c65f7b3c30 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30 2023-02-12 03:04:10,032 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 03:04:10,033 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e00c8e3443cbdaa404857f26d2cd6552 in 49ms, sequenceid=5, compaction requested=false 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e00c8e3443cbdaa404857f26d2cd6552: 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c] hfiles 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c for snapshot=testWithMapReduceSingleRegion 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30] hfiles 2023-02-12 03:04:10,033 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30 for snapshot=testWithMapReduceSingleRegion 2023-02-12 03:04:10,041 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. completed. 2023-02-12 03:04:10,041 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,041 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 03:04:10,041 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 03:04:10,041 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,042 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 03:04:10,042 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase6.apache.org,44303,1676171048153' in zk 2023-02-12 03:04:10,048 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,048 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:10,048 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:10,048 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase6.apache.org,44303,1676171048153': 2023-02-12 03:04:10,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44303,1676171048153' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 03:04:10,050 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-12 03:04:10,051 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:10,051 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:10,051 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-12 03:04:10,051 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:04:10,052 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:04:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,052 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,052 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:10,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:10,053 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:10,054 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,054 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,055 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:04:10,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:04:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:10,055 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:04:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 03:04:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:04:10,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:10,060 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:10,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:10,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:10,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-12 03:04:10,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:04:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:04:10,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 03:04:10,060 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,061 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:10,061 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:04:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:04:10,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 03:04:10,061 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 03:04:10,061 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 03:04:10,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-12 03:04:10,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-12 03:04:10,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 03:04:10,088 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 03:04:10,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676171049952Consolidate snapshot: testWithMapReduceSingleRegion at 1676171050060 (+108 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676171050060Writing data manifest for testWithMapReduceSingleRegion at 1676171050063 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676171050068 (+5 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676171050088 (+20 ms) 2023-02-12 03:04:10,091 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 03:04:10,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 138 msec 2023-02-12 03:04:10,255 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:04:10,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 03:04:10,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:04:10,257 INFO [Listener at localhost/41217] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 03:04:10,261 INFO [Listener at localhost/41217] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 03:04:10,265 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 03:04:10,369 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44303] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.20 first region in multi=testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,451 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 03:04:10,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(933): Client=jenkins//172.31.2.20 procedure request for: flush-table-proc 2023-02-12 03:04:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 03:04:10,457 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 03:04:10,457 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:10,457 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 03:04:10,458 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 03:04:10,458 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,458 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,459 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:10,459 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:10,459 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:10,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:10,459 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,459 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 03:04:10,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:04:10,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:04:10,461 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 03:04:10,461 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. started... 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:04:10,461 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44047,1676171048181' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:04:10,461 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e00c8e3443cbdaa404857f26d2cd6552 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 03:04:10,463 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,463 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,463 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:10,475 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f1/441bc11175574a95b1715113308a55b9 2023-02-12 03:04:10,493 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f2/4a364bd4f83b434b8a46001d806fef18 2023-02-12 03:04:10,497 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f1/441bc11175574a95b1715113308a55b9 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/441bc11175574a95b1715113308a55b9 2023-02-12 03:04:10,501 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/441bc11175574a95b1715113308a55b9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:10,501 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/.tmp/f2/4a364bd4f83b434b8a46001d806fef18 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/4a364bd4f83b434b8a46001d806fef18 2023-02-12 03:04:10,505 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/4a364bd4f83b434b8a46001d806fef18, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 03:04:10,506 INFO [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e00c8e3443cbdaa404857f26d2cd6552 in 45ms, sequenceid=9, compaction requested=false 2023-02-12 03:04:10,506 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e00c8e3443cbdaa404857f26d2cd6552: 2023-02-12 03:04:10,506 DEBUG [rs(jenkins-hbase6.apache.org,44303,1676171048153)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,506 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:04:10,506 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:04:10,506 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,506 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 03:04:10,506 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44303,1676171048153' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 03:04:10,509 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,509 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:10,509 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,509 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:04:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:10,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44303,1676171048153' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 03:04:10,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d378ef2[Count = 0] remaining members to acquire global barrier 2023-02-12 03:04:10,511 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 03:04:10,511 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,44303,1676171048153' in zk 2023-02-12 03:04:10,512 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,513 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:04:10,512 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase6.apache.org,44047,1676171048181' in zk 2023-02-12 03:04:10,514 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:04:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44303,1676171048153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 03:04:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:10,514 DEBUG [member: 'jenkins-hbase6.apache.org,44047,1676171048181' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 03:04:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase6.apache.org,44303,1676171048153': 2023-02-12 03:04:10,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44303,1676171048153' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 03:04:10,517 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 03:04:10,517 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:04:10,517 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:04:10,517 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 03:04:10,517 INFO [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:04:10,521 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:04:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:04:10,521 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:10,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:04:10,522 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,522 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:04:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:04:10,524 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 03:04:10,524 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,526 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,526 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:10,526 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,526 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:10,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:10,527 DEBUG [(jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:04:10,526 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 03:04:10,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:04:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 03:04:10,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:10,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 03:04:10,527 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:04:10,530 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:04:10,530 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:04:10,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:04:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:04:10,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:04:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:04:10,627 DEBUG [Listener at localhost/41217] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:04:10,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:04:10,721 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/hadoop-8920660228527628427.jar 2023-02-12 03:04:10,725 INFO [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676171049942 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:10,725 DEBUG [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df/data/default/testWithMapReduce 2023-02-12 03:04:10,726 INFO [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(239): region to add: e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:10,726 INFO [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(585): clone region=e00c8e3443cbdaa404857f26d2cd6552 as e00c8e3443cbdaa404857f26d2cd6552 in snapshot testWithMapReduceSingleRegion 2023-02-12 03:04:10,726 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e00c8e3443cbdaa404857f26d2cd6552, NAME => 'testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df 2023-02-12 03:04:10,732 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:10,732 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 921745e89d3547cfa068debdce6a756c from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 03:04:10,734 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d324b66f8ab44230bbf7c8c65f7b3c30 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 03:04:10,735 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e00c8e3443cbdaa404857f26d2cd6552, disabling compactions & flushes 2023-02-12 03:04:10,736 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. after waiting 0 ms 2023-02-12 03:04:10,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,736 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:10,736 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e00c8e3443cbdaa404857f26d2cd6552: Waiting for close lock at 1676171050735Disabling compacts and flushes for region at 1676171050735Disabling writes for close at 1676171050736 (+1 ms)Writing region close event to WAL at 1676171050736Closed at 1676171050736 2023-02-12 03:04:10,736 INFO [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676171049942 type: FLUSH version: 2 ttl: 0 2023-02-12 03:04:10,736 DEBUG [Listener at localhost/41217] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df 2023-02-12 03:04:10,736 DEBUG [Listener at localhost/41217] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df 2023-02-12 03:04:10,736 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |-data/ 2023-02-12 03:04:10,737 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |----default/ 2023-02-12 03:04:10,737 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 03:04:10,737 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |----------e00c8e3443cbdaa404857f26d2cd6552/ 2023-02-12 03:04:10,738 DEBUG [Listener at localhost/41217] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 03:04:10,738 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 03:04:10,738 DEBUG [Listener at localhost/41217] util.CommonFSUtils(702): |----------------testWithMapReduce=e00c8e3443cbdaa404857f26d2cd6552-921745e89d3547cfa068debdce6a756c 2023-02-12 03:04:10,738 DEBUG [Listener at localhost/41217] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 03:04:10,739 DEBUG [Listener at localhost/41217] util.CommonFSUtils(702): |----------------testWithMapReduce=e00c8e3443cbdaa404857f26d2cd6552-d324b66f8ab44230bbf7c8c65f7b3c30 2023-02-12 03:04:10,739 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,740 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,740 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,741 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,741 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,742 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,742 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,820 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/hadoop-921080451843000234.jar 2023-02-12 03:04:10,821 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,821 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,821 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,822 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,822 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,822 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,823 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 03:04:10,823 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 03:04:10,824 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 03:04:10,824 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 03:04:10,824 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 03:04:10,825 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 03:04:10,825 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 03:04:10,825 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 03:04:10,825 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 03:04:10,826 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 03:04:10,826 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 03:04:10,827 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:04:10,827 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:04:10,827 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 03:04:10,828 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:04:10,898 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/hadoop-6419897239071810138.jar 2023-02-12 03:04:10,898 DEBUG [Listener at localhost/41217] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 03:04:10,904 WARN [Listener at localhost/41217] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 03:04:10,939 INFO [Listener at localhost/41217] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 03:04:11,024 WARN [Listener at localhost/41217] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/mapreduce.cluster.local.dir/1676171050988/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 03:04:11,024 WARN [Listener at localhost/41217] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/mapreduce.cluster.local.dir/1676171050988/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 03:04:11,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:04:11,056 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 03:04:11,057 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:04:11,059 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:11,059 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1 2023-02-12 03:04:11,060 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00c8e3443cbdaa404857f26d2cd6552 columnFamilyName f1 2023-02-12 03:04:11,067 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(539): loaded hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/testWithMapReduce=e00c8e3443cbdaa404857f26d2cd6552-921745e89d3547cfa068debdce6a756c 2023-02-12 03:04:11,067 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(310): Store=e00c8e3443cbdaa404857f26d2cd6552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:11,067 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:11,068 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2 2023-02-12 03:04:11,068 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00c8e3443cbdaa404857f26d2cd6552 columnFamilyName f2 2023-02-12 03:04:11,071 DEBUG [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(539): loaded hdfs://localhost:34227/user/jenkins/test-data/1f7133c3-a3b7-a036-4c82-69a77a6a9ca5/testWithMapReduceSingleRegion/1ac64a7d-b389-42b8-a415-04ffb21db2df/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/testWithMapReduce=e00c8e3443cbdaa404857f26d2cd6552-d324b66f8ab44230bbf7c8c65f7b3c30 2023-02-12 03:04:11,072 INFO [StoreOpener-e00c8e3443cbdaa404857f26d2cd6552-1] regionserver.HStore(310): Store=e00c8e3443cbdaa404857f26d2cd6552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:04:11,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:04:11,072 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e00c8e3443cbdaa404857f26d2cd6552; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66363497, jitterRate=-0.011106833815574646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:04:11,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e00c8e3443cbdaa404857f26d2cd6552: Writing region info on filesystem at 1676171051057Initializing all the Stores at 1676171051058 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171051058Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676171051058Region opened successfully at 1676171051072 (+14 ms) 2023-02-12 03:04:11,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e00c8e3443cbdaa404857f26d2cd6552, disabling compactions & flushes 2023-02-12 03:04:11,152 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:11,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:11,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. after waiting 0 ms 2023-02-12 03:04:11,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:11,153 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:11,153 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e00c8e3443cbdaa404857f26d2cd6552: Waiting for close lock at 1676171051152Disabling compacts and flushes for region at 1676171051152Disabling writes for close at 1676171051152Writing region close event to WAL at 1676171051153 (+1 ms)Closed at 1676171051153 2023-02-12 03:04:12,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(748): Client=jenkins//172.31.2.20 delete name: "testWithMapReduceSingleRegion" 2023-02-12 03:04:12,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-12 03:04:12,062 INFO [Listener at localhost/41217] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 03:04:12,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.HMaster$11(2405): Client=jenkins//172.31.2.20 disable testWithMapReduce 2023-02-12 03:04:12,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:12,066 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171052066"}]},"ts":"1676171052066"} 2023-02-12 03:04:12,067 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 03:04:12,069 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 03:04:12,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, UNASSIGN}] 2023-02-12 03:04:12,070 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, UNASSIGN 2023-02-12 03:04:12,070 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e00c8e3443cbdaa404857f26d2cd6552, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:12,070 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676171052070"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676171052070"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676171052070"}]},"ts":"1676171052070"} 2023-02-12 03:04:12,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e00c8e3443cbdaa404857f26d2cd6552, server=jenkins-hbase6.apache.org,44303,1676171048153}] 2023-02-12 03:04:12,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:12,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(109): Close e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:12,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing e00c8e3443cbdaa404857f26d2cd6552, disabling compactions & flushes 2023-02-12 03:04:12,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:12,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:12,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. after waiting 0 ms 2023-02-12 03:04:12,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:12,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 03:04:12,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552. 2023-02-12 03:04:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for e00c8e3443cbdaa404857f26d2cd6552: Waiting for close lock at 1676171052224Running coprocessor pre-close hooks at 1676171052224Disabling compacts and flushes for region at 1676171052224Disabling writes for close at 1676171052224Writing region close event to WAL at 1676171052225 (+1 ms)Running coprocessor post-close hooks at 1676171052228 (+3 ms)Closed at 1676171052228 2023-02-12 03:04:12,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(147): Closed e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:12,229 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e00c8e3443cbdaa404857f26d2cd6552, regionState=CLOSED 2023-02-12 03:04:12,230 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676171052229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676171052229"}]},"ts":"1676171052229"} 2023-02-12 03:04:12,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 03:04:12,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e00c8e3443cbdaa404857f26d2cd6552, server=jenkins-hbase6.apache.org,44303,1676171048153 in 160 msec 2023-02-12 03:04:12,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 03:04:12,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e00c8e3443cbdaa404857f26d2cd6552, UNASSIGN in 163 msec 2023-02-12 03:04:12,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676171052234"}]},"ts":"1676171052234"} 2023-02-12 03:04:12,235 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 03:04:12,237 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 03:04:12,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-12 03:04:12,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 03:04:12,368 INFO [Listener at localhost/41217] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-12 03:04:12,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.HMaster$5(2215): Client=jenkins//172.31.2.20 delete testWithMapReduce 2023-02-12 03:04:12,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,371 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,372 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:12,375 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:12,376 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1, FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2, FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/recovered.edits] 2023-02-12 03:04:12,379 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/441bc11175574a95b1715113308a55b9 to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/archive/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/441bc11175574a95b1715113308a55b9 2023-02-12 03:04:12,380 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/archive/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f1/921745e89d3547cfa068debdce6a756c 2023-02-12 03:04:12,382 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/4a364bd4f83b434b8a46001d806fef18 to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/archive/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/4a364bd4f83b434b8a46001d806fef18 2023-02-12 03:04:12,383 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30 to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/archive/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/f2/d324b66f8ab44230bbf7c8c65f7b3c30 2023-02-12 03:04:12,385 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/recovered.edits/12.seqid to hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/archive/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552/recovered.edits/12.seqid 2023-02-12 03:04:12,386 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/.tmp/data/default/testWithMapReduce/e00c8e3443cbdaa404857f26d2cd6552 2023-02-12 03:04:12,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 03:04:12,387 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,389 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-12 03:04:12,390 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 03:04:12,391 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,391 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 03:04:12,391 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676171052391"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:12,393 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 03:04:12,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e00c8e3443cbdaa404857f26d2cd6552, NAME => 'testWithMapReduce,,1676171049218.e00c8e3443cbdaa404857f26d2cd6552.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 03:04:12,393 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 03:04:12,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676171052393"}]},"ts":"9223372036854775807"} 2023-02-12 03:04:12,394 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 03:04:12,395 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 03:04:12,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 26 msec 2023-02-12 03:04:12,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46173] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 03:04:12,474 INFO [Listener at localhost/41217] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-12 03:04:12,474 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:04:12,474 INFO [Listener at localhost/41217] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:04:12,474 DEBUG [Listener at localhost/41217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e4b6d0 to 127.0.0.1:58898 2023-02-12 03:04:12,475 DEBUG [Listener at localhost/41217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,475 DEBUG [Listener at localhost/41217] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:04:12,475 DEBUG [Listener at localhost/41217] util.JVMClusterUtil(257): Found active master hash=720604275, stopped=false 2023-02-12 03:04:12,475 INFO [Listener at localhost/41217] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:12,476 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:12,476 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:12,476 INFO [Listener at localhost/41217] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:04:12,476 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:04:12,477 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:12,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:12,479 DEBUG [Listener at localhost/41217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17e519e3 to 127.0.0.1:58898 2023-02-12 03:04:12,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:12,479 DEBUG [Listener at localhost/41217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:04:12,479 INFO [Listener at localhost/41217] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44303,1676171048153' ***** 2023-02-12 03:04:12,480 INFO [Listener at localhost/41217] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:12,480 INFO [Listener at localhost/41217] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,44047,1676171048181' ***** 2023-02-12 03:04:12,480 INFO [Listener at localhost/41217] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:04:12,480 INFO [RS:0;jenkins-hbase6:44303] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:12,480 INFO [RS:1;jenkins-hbase6:44047] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:04:12,480 INFO [RS:0;jenkins-hbase6:44303] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:12,480 INFO [RS:1;jenkins-hbase6:44047] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:04:12,480 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:12,480 INFO [RS:1;jenkins-hbase6:44047] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:12,480 INFO [RS:0;jenkins-hbase6:44303] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:04:12,481 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(3304): Received CLOSE for 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:12,481 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:12,480 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:04:12,481 DEBUG [RS:0;jenkins-hbase6:44303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f0c1ee7 to 127.0.0.1:58898 2023-02-12 03:04:12,481 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:12,482 DEBUG [RS:0;jenkins-hbase6:44303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 070d6b0575157bb4723e52f837a0fede, disabling compactions & flushes 2023-02-12 03:04:12,482 DEBUG [RS:1;jenkins-hbase6:44047] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc9723b to 127.0.0.1:58898 2023-02-12 03:04:12,482 DEBUG [RS:1;jenkins-hbase6:44047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,482 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 03:04:12,482 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1479): Online Regions={070d6b0575157bb4723e52f837a0fede=hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede.} 2023-02-12 03:04:12,482 DEBUG [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1505): Waiting on 070d6b0575157bb4723e52f837a0fede 2023-02-12 03:04:12,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:12,482 INFO [RS:0;jenkins-hbase6:44303] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:12,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:12,482 INFO [RS:0;jenkins-hbase6:44303] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:12,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. after waiting 0 ms 2023-02-12 03:04:12,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:12,482 INFO [RS:0;jenkins-hbase6:44303] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:12,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 070d6b0575157bb4723e52f837a0fede 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 03:04:12,483 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:04:12,483 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 03:04:12,483 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 03:04:12,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:04:12,483 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:04:12,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:04:12,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:04:12,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:04:12,483 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-12 03:04:12,483 DEBUG [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 03:04:12,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/.tmp/info/2201b57e56fa476cb4d96fe512ea0428 2023-02-12 03:04:12,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/info/4459ec97f78d4e478a95643721096171 2023-02-12 03:04:12,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/.tmp/info/2201b57e56fa476cb4d96fe512ea0428 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/info/2201b57e56fa476cb4d96fe512ea0428 2023-02-12 03:04:12,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4459ec97f78d4e478a95643721096171 2023-02-12 03:04:12,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/info/2201b57e56fa476cb4d96fe512ea0428, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 03:04:12,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 070d6b0575157bb4723e52f837a0fede in 16ms, sequenceid=6, compaction requested=false 2023-02-12 03:04:12,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/namespace/070d6b0575157bb4723e52f837a0fede/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 03:04:12,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:12,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 070d6b0575157bb4723e52f837a0fede: Waiting for close lock at 1676171052482Running coprocessor pre-close hooks at 1676171052482Disabling compacts and flushes for region at 1676171052482Disabling writes for close at 1676171052482Obtaining lock to block concurrent updates at 1676171052483 (+1 ms)Preparing flush snapshotting stores in 070d6b0575157bb4723e52f837a0fede at 1676171052483Finished memstore snapshotting hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676171052483Flushing stores of hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. at 1676171052483Flushing 070d6b0575157bb4723e52f837a0fede/info: creating writer at 1676171052483Flushing 070d6b0575157bb4723e52f837a0fede/info: appending metadata at 1676171052485 (+2 ms)Flushing 070d6b0575157bb4723e52f837a0fede/info: closing flushed file at 1676171052485Flushing 070d6b0575157bb4723e52f837a0fede/info: reopening flushed file at 1676171052495 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 070d6b0575157bb4723e52f837a0fede in 16ms, sequenceid=6, compaction requested=false at 1676171052499 (+4 ms)Writing region close event to WAL at 1676171052500 (+1 ms)Running coprocessor post-close hooks at 1676171052503 (+3 ms)Closed at 1676171052504 (+1 ms) 2023-02-12 03:04:12,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676171048724.070d6b0575157bb4723e52f837a0fede. 2023-02-12 03:04:12,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/rep_barrier/d5027d51b5014ec28bc48afb503fb722 2023-02-12 03:04:12,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5027d51b5014ec28bc48afb503fb722 2023-02-12 03:04:12,524 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/table/8b8eaf25714c44ab96debd32ddb0a7c1 2023-02-12 03:04:12,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b8eaf25714c44ab96debd32ddb0a7c1 2023-02-12 03:04:12,529 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/info/4459ec97f78d4e478a95643721096171 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/info/4459ec97f78d4e478a95643721096171 2023-02-12 03:04:12,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4459ec97f78d4e478a95643721096171 2023-02-12 03:04:12,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/info/4459ec97f78d4e478a95643721096171, entries=12, sequenceid=21, filesize=6.2 K 2023-02-12 03:04:12,533 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/rep_barrier/d5027d51b5014ec28bc48afb503fb722 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/rep_barrier/d5027d51b5014ec28bc48afb503fb722 2023-02-12 03:04:12,536 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 03:04:12,536 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5027d51b5014ec28bc48afb503fb722 2023-02-12 03:04:12,536 INFO [regionserver/jenkins-hbase6:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 03:04:12,536 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/rep_barrier/d5027d51b5014ec28bc48afb503fb722, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:04:12,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/.tmp/table/8b8eaf25714c44ab96debd32ddb0a7c1 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/table/8b8eaf25714c44ab96debd32ddb0a7c1 2023-02-12 03:04:12,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b8eaf25714c44ab96debd32ddb0a7c1 2023-02-12 03:04:12,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/table/8b8eaf25714c44ab96debd32ddb0a7c1, entries=4, sequenceid=21, filesize=5.0 K 2023-02-12 03:04:12,541 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=21, compaction requested=false 2023-02-12 03:04:12,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 03:04:12,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:04:12,545 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:12,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676171052483Running coprocessor pre-close hooks at 1676171052483Disabling compacts and flushes for region at 1676171052483Disabling writes for close at 1676171052483Obtaining lock to block concurrent updates at 1676171052483Preparing flush snapshotting stores in 1588230740 at 1676171052483Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676171052483Flushing stores of hbase:meta,,1.1588230740 at 1676171052484 (+1 ms)Flushing 1588230740/info: creating writer at 1676171052484Flushing 1588230740/info: appending metadata at 1676171052486 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676171052486Flushing 1588230740/rep_barrier: creating writer at 1676171052496 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676171052498 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676171052498Flushing 1588230740/table: creating writer at 1676171052507 (+9 ms)Flushing 1588230740/table: appending metadata at 1676171052509 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676171052509Flushing 1588230740/info: reopening flushed file at 1676171052529 (+20 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676171052533 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676171052537 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=21, compaction requested=false at 1676171052541 (+4 ms)Writing region close event to WAL at 1676171052542 (+1 ms)Running coprocessor post-close hooks at 1676171052544 (+2 ms)Closed at 1676171052545 (+1 ms) 2023-02-12 03:04:12,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:04:12,551 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:12,559 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:12,682 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44047,1676171048181; all regions closed. 2023-02-12 03:04:12,683 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,44303,1676171048153; all regions closed. 2023-02-12 03:04:12,687 DEBUG [RS:1;jenkins-hbase6:44047] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44047%2C1676171048181:(num 1676171049072) 2023-02-12 03:04:12,688 DEBUG [RS:1;jenkins-hbase6:44047] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:12,688 DEBUG [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs 2023-02-12 03:04:12,688 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:04:12,688 INFO [RS:1;jenkins-hbase6:44047] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:04:12,688 INFO [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44303%2C1676171048153.meta:.meta(num 1676171048674) 2023-02-12 03:04:12,689 INFO [RS:1;jenkins-hbase6:44047] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44047 2023-02-12 03:04:12,691 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:12,691 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:12,691 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50b21edd rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:12,692 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:12,692 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60505b57 rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:12,692 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44047,1676171048181 2023-02-12 03:04:12,692 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44047,1676171048181] 2023-02-12 03:04:12,692 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:12,692 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44047,1676171048181; numProcessing=1 2023-02-12 03:04:12,693 DEBUG [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/oldWALs 2023-02-12 03:04:12,693 INFO [RS:0;jenkins-hbase6:44303] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44303%2C1676171048153:(num 1676171049480) 2023-02-12 03:04:12,693 DEBUG [RS:0;jenkins-hbase6:44303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,693 INFO [RS:0;jenkins-hbase6:44303] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:04:12,694 INFO [RS:0;jenkins-hbase6:44303] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:04:12,694 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:12,697 INFO [RS:0;jenkins-hbase6:44303] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44303 2023-02-12 03:04:12,697 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44047,1676171048181 already deleted, retry=false 2023-02-12 03:04:12,697 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44047,1676171048181 expired; onlineServers=1 2023-02-12 03:04:12,698 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44303,1676171048153 2023-02-12 03:04:12,698 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:04:12,699 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b219653 rejected from java.util.concurrent.ThreadPoolExecutor@4f1e0bef[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:12,700 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44303,1676171048153] 2023-02-12 03:04:12,700 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44303,1676171048153; numProcessing=2 2023-02-12 03:04:12,703 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44303,1676171048153 already deleted, retry=false 2023-02-12 03:04:12,703 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44303,1676171048153 expired; onlineServers=0 2023-02-12 03:04:12,703 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase6.apache.org,46173,1676171048094' ***** 2023-02-12 03:04:12,703 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:04:12,704 DEBUG [M:0;jenkins-hbase6:46173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ecc0df5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-02-12 03:04:12,704 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegionServer(1145): stopping server jenkins-hbase6.apache.org,46173,1676171048094 2023-02-12 03:04:12,704 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegionServer(1171): stopping server jenkins-hbase6.apache.org,46173,1676171048094; all regions closed. 2023-02-12 03:04:12,704 DEBUG [M:0;jenkins-hbase6:46173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:04:12,704 DEBUG [M:0;jenkins-hbase6:46173] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:04:12,704 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:04:12,704 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171048331] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1676171048331,5,FailOnTimeoutGroup] 2023-02-12 03:04:12,704 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171048331] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1676171048331,5,FailOnTimeoutGroup] 2023-02-12 03:04:12,704 DEBUG [M:0;jenkins-hbase6:46173] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:04:12,705 INFO [M:0;jenkins-hbase6:46173] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:04:12,705 INFO [M:0;jenkins-hbase6:46173] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:04:12,705 INFO [M:0;jenkins-hbase6:46173] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-02-12 03:04:12,706 DEBUG [M:0;jenkins-hbase6:46173] master.HMaster(1502): Stopping service threads 2023-02-12 03:04:12,706 INFO [M:0;jenkins-hbase6:46173] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:04:12,706 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:04:12,706 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:04:12,706 ERROR [M:0;jenkins-hbase6:46173] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 03:04:12,706 INFO [M:0;jenkins-hbase6:46173] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:04:12,707 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:04:12,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:04:12,707 DEBUG [M:0;jenkins-hbase6:46173] zookeeper.ZKUtil(398): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:04:12,707 WARN [M:0;jenkins-hbase6:46173] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:04:12,707 INFO [M:0;jenkins-hbase6:46173] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:04:12,707 INFO [M:0;jenkins-hbase6:46173] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:04:12,708 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:04:12,708 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:12,708 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:12,708 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:04:12,708 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:12,708 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-12 03:04:12,715 INFO [M:0;jenkins-hbase6:46173] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a4d89adfb90454ea7839fca7d8bfda4 2023-02-12 03:04:12,719 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a4d89adfb90454ea7839fca7d8bfda4 as hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a4d89adfb90454ea7839fca7d8bfda4 2023-02-12 03:04:12,723 INFO [M:0;jenkins-hbase6:46173] regionserver.HStore(1080): Added hdfs://localhost:34227/user/jenkins/test-data/5b23a8c4-251d-5ef0-4a16-152dcf3f6f61/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a4d89adfb90454ea7839fca7d8bfda4, entries=17, sequenceid=132, filesize=8.6 K 2023-02-12 03:04:12,724 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 03:04:12,724 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:04:12,724 DEBUG [M:0;jenkins-hbase6:46173] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676171052708Disabling compacts and flushes for region at 1676171052708Disabling writes for close at 1676171052708Obtaining lock to block concurrent updates at 1676171052708Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676171052708Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676171052708Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676171052709 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676171052709Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676171052711 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676171052711Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676171052720 (+9 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676171052724 (+4 ms)Writing region close event to WAL at 1676171052724Closed at 1676171052724 2023-02-12 03:04:12,726 INFO [M:0;jenkins-hbase6:46173] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:04:12,726 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:04:12,726 INFO [M:0;jenkins-hbase6:46173] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:46173 2023-02-12 03:04:12,728 DEBUG [M:0;jenkins-hbase6:46173] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,46173,1676171048094 already deleted, retry=false 2023-02-12 03:04:12,977 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:12,977 INFO [M:0;jenkins-hbase6:46173] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,46173,1676171048094; zookeeper connection closed. 2023-02-12 03:04:12,978 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@11416cef rejected from java.util.concurrent.ThreadPoolExecutor@157efa1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:12,979 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): master:46173-0x10154e9a8cd0000, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:12,979 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b5a985d rejected from java.util.concurrent.ThreadPoolExecutor@157efa1f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:13,078 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:13,078 INFO [RS:0;jenkins-hbase6:44303] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44303,1676171048153; zookeeper connection closed. 2023-02-12 03:04:13,078 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c88f72c rejected from java.util.concurrent.ThreadPoolExecutor@4f1e0bef[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:13,078 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44303-0x10154e9a8cd0001, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:13,078 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a24007 rejected from java.util.concurrent.ThreadPoolExecutor@4f1e0bef[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:13,078 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c715e77] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c715e77 2023-02-12 03:04:13,178 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:13,178 INFO [RS:1;jenkins-hbase6:44047] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase6.apache.org,44047,1676171048181; zookeeper connection closed. 2023-02-12 03:04:13,178 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18e1f477 rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:13,178 DEBUG [Listener at localhost/41217-EventThread] zookeeper.ZKWatcher(600): regionserver:44047-0x10154e9a8cd0002, quorum=127.0.0.1:58898, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:04:13,178 ERROR [Listener at localhost/41217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13c89c29 rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:04:13,178 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@be85f2a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@be85f2a 2023-02-12 03:04:13,178 INFO [Listener at localhost/41217] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 03:04:13,179 WARN [Listener at localhost/41217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:13,182 INFO [Listener at localhost/41217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:13,283 WARN [BP-758988944-172.31.2.20-1676171047497 heartbeating to localhost/127.0.0.1:34227] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:13,284 WARN [BP-758988944-172.31.2.20-1676171047497 heartbeating to localhost/127.0.0.1:34227] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-758988944-172.31.2.20-1676171047497 (Datanode Uuid e6bbeac9-81fe-4411-9221-b89219c64b69) service to localhost/127.0.0.1:34227 2023-02-12 03:04:13,284 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/dfs/data/data3/current/BP-758988944-172.31.2.20-1676171047497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:13,285 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/dfs/data/data4/current/BP-758988944-172.31.2.20-1676171047497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:13,287 WARN [Listener at localhost/41217] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:04:13,296 INFO [Listener at localhost/41217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:13,397 WARN [BP-758988944-172.31.2.20-1676171047497 heartbeating to localhost/127.0.0.1:34227] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:04:13,397 WARN [BP-758988944-172.31.2.20-1676171047497 heartbeating to localhost/127.0.0.1:34227] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-758988944-172.31.2.20-1676171047497 (Datanode Uuid c9699414-df1a-4291-b983-03a7eb31feae) service to localhost/127.0.0.1:34227 2023-02-12 03:04:13,398 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/dfs/data/data1/current/BP-758988944-172.31.2.20-1676171047497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:13,398 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2650bb57-fa77-9f69-e946-92961a00a528/cluster_c129f3dd-5b90-769a-aa4e-cea27874adcc/dfs/data/data2/current/BP-758988944-172.31.2.20-1676171047497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:04:13,410 INFO [Listener at localhost/41217] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:04:13,523 INFO [Listener at localhost/41217] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:04:13,547 INFO [Listener at localhost/41217] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 03:04:13,561 INFO [Listener at localhost/41217] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 275) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34227 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34227 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:34227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:34227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41217 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,46173,1676171048094)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1608878744) connection to localhost/127.0.0.1:34227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34227 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 566) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 269) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5214 (was 5282)